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Abstract. We present a general method for introducing finitely axiomatizable "minimal" 
two-sorted theories for various subclasses of P (problems solvable in polynomial time). The 
two sorts are natural numbers and finite sets of natural numbers. The latter are essentially 
the finite binary strings, which provide a natural domain for defining the functions and sets 
in small complexity classes. We concentrate on the complexity class TC°, whose problems 
are defined by uniform polynomial-size families of bounded-depth Boolean circuits with 
majority gates. We present an elegant theory VTC° in which the provably-total functions 
are those associated with TC°, and then prove that VTC° is "isomorphic" to a different- 
looking single-sorted theory introduced by Johannsen and Pollet. The most technical part 
of the isomorphism proof is defining binary number multiplication in terms a bit-counting 
function, and showing how to formalize the proofs of its algebraic properties. 



1. Introduction 

Non-uniform AC is the class of languages accepted by polynomial-size families of 
constant-depth Boolean circuits (where the gates have unbounded fan-in). Non- uniform 
TC° is defined similarly, where the circuits may contain majority gates (i.e., gates with 
unbounded fan-in, which output 1 if and only if the number of 1 inputs is more than the 
number of inputs), and for non-uniform AC (to) 1 the additional gates are mod m gates, 
i.e., gates with unbounded fan-in which output 1 if and only if the number of 1 inputs is 
exactly 1 modulo to. 

Each of these classes has a uniform version, where the families of circuits are uniform. 
Here we consider FO-uniformity |Imm99j , i.e., each circuit family can be described by some 
first-order formula. We will focus on the uniform classes, and will simply use AC , TC° 
and AC (to,) without the adjective "uniform". 

Each of these classes can be defined more generally as a class of relations rather than 
languages. A class C is then associated with a function class FC, which is essentially the 
set of functions of at most polynomial growth whose bit graphs are in C. Then TC° (resp. 
FTC ) is the class of problems (resp. functions) AC reducible to the counting function, 
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which outputs the number of 1 bits in the input string. The same holds for AC°(m) and 
FAC°(m), with the modulo m function instead of the counting function. 
It is known that 

AC C AC°{p) C AC (pq) C ACC C TC° C NC 1 , 

for any distinct prime numbers p, q, where ACC = Um=2 AC°(m). However it is an open 
question whether any of last three inclusions is strict. It is also unknown, for example, 
whether AC°(6) C NC 1 , although AC°(p) / AC°(q) for distinct prime numbers p,q. 

In this paper we study second-order logical theories associated with these and other 
complexity classes. We show that our theories VTC and V°(m) characterize TC° and 
AC°(m) in the same way that Buss's theories S2, S|, • • • characterize the polynomial time 
hierarchy fBusSG. Thus we show that FTC is precisely the class of S^-definable functions 
of VTC°, and similarly FAC°(m) is the class of Indefinable functions of V°(m). 

In Section 21 we show that our theory VTC° is RSUV isomorphic to A^-CR, a "mini- 
mal" first-order theory that also characterizes TC° [JPQO] but which is defined very differ- 
ently from VTC . Since VTC° is finitely axiomatizable, it follows that A^-CR is also, and 
this answers an open question in |JP00j by showing that there is a constant upper bound to 
the nesting depth of the A^ bit-comprehension rule required to prove theorems in A^-CR. 
Our RSUV isomorphism is more difficult than the original ones given in |Raz931 fTak93j . as 
we explain below in Section \l.'2l 

The theory VTC° is obtained by adding to the "base" theory V° jZam961 ICoo05| (a 
theory that characterizes AC ) the axiom NUMONES which encodes the counting function 
which is complete for TC°. This is indeed a generic method that can be used to develop 
"minimal", finitely axiomatizable theories characterizing other small classes, including the 
sequence 

NC 1 CLCSLCNLCNCCP 

In proving that our theories characterize the corresponding classes, we follow the approach 
laid down in Coo05j which uses "minimal", universal theories over the languages of the 
functions in the corresponding classes. The universal counterpart of VTC° is called VTC . 
The main tasks remaining are to (i) show that the universal theories (such as VTC°) are 
conservative extensions of the original theories (e.g., VTC ); and (ii) prove the Witnessing 
Theorems for the universal theories. The general results in Theorem 13 . 1 51 and Theorem l3.2()l 
(the General Witnessing Theorem) should be useful for these purposes in other contexts. 

Our universal theories are "minimal" theories for the corresponding complexity classes 
in the sense that the axioms consist of straightforward definitions for the functions and 
predicates in the class. For example, VTC satisfies this condition, and since it is a con- 
servative extension of VTC , the latter is also a minimal theory for TC°, and so is its 
first-order counterpart A^-CR. However as explained below, the extensions R and C° of 
A^-CR also define precisely the TC° functions, but they prove E| theorems which (un- 
der a cryptographic assumption) are not provable in A^-CR and hence are apparently not 
minimal theories for TC°. 

This paper is based in part on its precursors Ngu04 and |NC04| . 

1.1. Previous First-Order Theories for our Classes. In CT95I, Clote and Takeuti 
introduce the notion of essentially sharply bounded (esb) formulas in a theory T. They 
introduce the first-order theories TAC°(2), TAC°(6), and TTC°, and show that a function 
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is esb-definable in one of these theories iff it is in AC (2), AC (6), or TC°, respectively. 
However, the notion of esb-definable seems unnecessarily complicated. 

In |Joh96j . Johannsen introduces the first-order theory R , and shows that the class of 
TC° functions is exactly the class of functions E^-definable in R . In JP98 , Johannsen 
and Pollett introduce a hierarchy {C^}fc>i of first-order theories, where characterizes 
the class of functions computable by families of constant-depth threshold circuits of size 
bounded by rfc(n), where ri(n) = 0(n),Tk+i(n) = 2 Tk ^ logn \ In particular, C° captures 
TC°. Later Johannsen and Pollett pPOO introduce the "minimal" theory A^-CR for TC° 
mentioned above. This theory is defined using a set of axioms (BASIC together with 
Open-LIND ), and the A\ bit- comprehension rule. It is easy to see that A^-CR is a 
subset of both R°and C[], and it follows from a result of Cook and Thapen |CT04| that 
A^-CR is a proper subset of both unless the RSA encryption scheme can be cracked in 
polynomial time. 

The equational theories A2V and TV introduced by Johannsen Joh98 characterize 
AC (2) and TC°, respectively. These theories appear to be RSUV isomorphic respectively 
to our second-order theories V°(2) and VTC°. One direction is clear: the axioms of the 
equational theories translate to theorems of the second-order theories. To show the reverse 
direction would require working out detailed proofs in the equational theories. 

We show in Section |I] that VTC° is RSUV isomorphic to A^-CR. From this and the 
previous paragraph it appears that TV and A^-CR are equivalent. 

1.2. Second-Order Theories for TC°. In [JP98] . the first-order theories C° k+1 (k > 1) 
are shown to be RSUV isomorphic to the second-order theories D^. Thus, can be seen as 
a theory for TC°. By the results of Cook and Thapen |CT04j discussed above, D° appears 
to be stronger than our theory VTC°. 

In |Jan95j . Krajicek introduces the theory (IY^ b ) count and notes that it should corre- 
spond to constant-depth FC, where FC is an extension of Frege proof systems. It turns 
out that our theory VTC° is essentially the same as (IT^ b ) count , but we note that Krajicek 
does not treat his theory in detail. 

As argued in |Coo05j , it seems that the second-order logic used here is more appropriate 
for reasoning about small complexity classes. The usual first-order theories of bounded 
arithmetic (including most of those described above for TC°) include multiplication as a 
primitive operation, and include axioms such as x-y = y ■ x. Our second-order theories have 
no primitive operations on second-order objects (strings) other than length. One advantage 
of this simplicity comes in the easy description of the propositional translations of these 
theories |Coo05j . In order to show the RSUV isomorphism in Section |I] between VTC° and 
A^-CR we must define binary multiplication in VTC° and prove its properties, which is 
not an easy task. But the alternative of simply assuming the commutative and distributive 
laws as axioms is "cheating", rather like throwing in axioms for the commutativity of 
multiplication in a propositional proof system for TC°. 

1.3. Organization. Section |2] presents the syntax and semantics of our second-order the- 
ories, and defines the second-order versions of the complexity classes AC , TC°, AC (m), 
and ACC. Characterizations of TC° and AC°(m) are given in terms of threshold quanti- 
fiers and modulo m quantifiers, respectively. 

Section |3] defines a finitely axiomatized theory for each of the complexity classes men- 
tioned in the introduction, and introduces a universal conservative extension of each of 
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these theories which has function symbols for each function in the associated class. The 
main theorems state that the E^-definable functions in each theory are the functions in 
the associated complexity class. The theory VTC° for TC° is treated in detail, and then 
a general method is introduced for defining theories for other subclasses of P. A general 
witnessing theorem is proved. 

Section 21 proves that our finitely-axiomatized second-order theory VTC° is isomorphic 
to the first-order theory A^-CR of Johannsen and Pollett. It follows that there is a fixed 
upper bound of the nesting depth of applications of the A\ bit-comprehension rule required 
for proofs in A^-CR, which answers an open question in |.TP00| . 

Section summarizes our main contributions. Appendix lAl gives some details of the 
RSUV isomorphism proof, and AppendixlBl shows how the proof of the Pigeonhole Principle 
can be formalized in VTC°. 

2. Second-Order Logic 

2.1. Syntax and Semantics. We use the two-sorted syntax of Zambella [Zam96| IZam97j 
(see also |Coo05l ICooj ). which was inspired by Buss's second-order theories defined in 
Bus86 . Our language has two sorts of variables: the number variables x, y, z, . . . whose 
intended values are natural numbers; and string variables X, Y, Z, . . ., whose intended val- 
ues are finite sets of natural numbers (which represent binary strings). Our two-sorted 
vocabulary C 2 A extends that of Peano Arithmetic: 

£ 2 A = [Q,l,+,-,\ \;e,<=\= 2 }. 

Here | | is a function from strings to numbers, and the intended meaning of |A| is 1 plus 
the largest element of X. The binary predicate £ denotes set membership. We will use 
the abbreviation X(t) for t € X. The equality predicates =1 and = 2 are for numbers and 
strings, respectively. We will write = for both = x and = 2 ; the exact meaning will be clear 
from the context. The other symbols have their standard meanings. 

Number terms are built from the constants 0,1, variables x,y,z,..., and length terms 
\X\ using + and •. We use s,t,... for number terms. The only string terms are string 
variables X, Y, Z, .... The atomic formulas are T, _L, (for True, False), s = t, X = Y, s < t, 
t E X for any number terms s, t and string variables X, Y. Formulas are built from atomic 
formulas using A, V,-i and both number and string quantifiers 3x, 3X, Mx, MX. Bounded 
number quantifiers are defined as usual, and the bounded string quantifier 3X <tip stands 
for 3X(|X| <tA(p) and MX < t cp stands for VX(|X| < t D ip), where X does not occur in 
the term t. 

A structure for C\ is defined in the same way as a structure for a single-sorted language, 
except now there are two nonempty domains U\ and U2, one for numbers and one for strings. 
Each symbol of C 2 A is interpreted in (U\, U2) by a relation or function of appropriate type, 
with = x and = 2 interpreted as true equality on Ci and U2, respectively. In the standard 
structure N 2 , U\ is N and U2 is the set of finite subsets of N. Each symbol of C 2 A gets its 
intended interpretation. 

In general we will consider a vocabulary C which extends C\. We require that the 
bounding terms (for the bounded quantifiers) are restricted to mention the functions of 
C A only. A formula is ~Sq(C) if it has no string quantifiers and all number quantifiers are 
bounded. A formula is Sf (£) (II;f (£), 5]}(£), resp.) if it is a E^(£) formula preceded 
by a block of quantifiers of the form 3X < t (MX < t, 3X, resp.). If the block contains 
a single quantifier, the formula is also called single-Sf (£) (single-II^(£), single-S}(£), 
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resp.). A formula is gS 1 (£) (resp. gTl 1 (£)) if it is obtained from Sq (£) formulas using the 
connectives A and V, bounded number quantifiers and bounded existential (resp. universal) 
string quantifiers ("g" for "general"). A formula is 3gHf(jC) if it is of the form 3X(p, where 
if is gSf (£). We will omit £ if it is C\. 

The "Sf formulas correspond to (in first-order logic) strict formulas (i.e., formulas 
where no bounded quantifier is inside the scope of any sharply bounded quantifier), while 
gSf formulas correspond to formulas. Similar for Tlf and gTlf formulas. 

2.2. Two- Sorted Complexity Classes. We study two-sorted versions of standard com- 
plexity classes, where the two sorts are those in the standard model N 2 for C\: the natural 
numbers and finite subsets of the natural numbers. When a class is defined in terms of 
machines or circuits, we assume that each number input is represented in unary notation 
(i.e., n is represented as a string of n l's), and each finite subset X is represented by its 
characteristic bit string. 

There are two kinds of functions: number functions and string functions. A number 
function f(x, X) takes values in N, and a string function F(x, X) take values in finite subsets 
of N. A function f(x, X) or F(x, X) is polynomially bounded (or p-bounded) if there is a 
polynomial p(x,y) such that f(x,X) < p(x, \X\), or \F(x,X)\ < p(x, \X\). The functions 
classes we consider here contain only p-bounded functions. 

The class (uniform) AC can be characterized as the set of relations R(x, X) which 
are accepted by alternating Turing machines in time 0(log(n)) with constant alternations. 
The following result is from |Imm991 ICooj . 

Theorem 2.1. A relation R(x,X) is in AC iff it is represented by some formula 
ip{x,X). 

We define AC reducibility in the "Turing" style, as opposed to the many-one style. 
The idea is (see for example jHISflOj l that F is AC reducible to C if F can be computed by 
a (uniform) polynomial size constant depth family of circuits which have unbounded fan-in 
gates computing functions from £, in addition to Boolean gates. We follow . CooQ §] and 
make this precise in Definition 12.31 below, based on Theorem 12.11 

The bit graph Bp(z,x,X) of a string function F(x, X) is defined by the condition 

B F (z,x,X) = F(S,X){z) (2.1) 

Definition 2.2. A string function is Xl^-definable from a collection C of two-sorted func- 
tions and relations if it is p-bounded and its bit graph is represented by a X^(£) formula. 
Similarly, a number function is 5]^-definable from C if it is p-bounded and its graph is 
represented by a E^(£) formula. 

Definition 2.3. We say that a string function F (resp. a number function f) is AC 
reducible to C if there is a sequence of string functions F±, . . . , F n (n > 0) such that 

Fi is 'Sq -definable from C U {F±, . . . , -Fi-i}, for i = 1, . . . , n; (2-2) 

and that F (resp. f) is -definable from CLi{F\, . . . , F n }. A relation R is AC reducible to 
C if there is a sequence F\, . . . ,F n as above, and R is represented by a ~£q (£u{Fi, . . . , F n }) 
formula. 

The uniform classes TC°, AC°(m), and ACC can be defined in several equivalent ways 
BIS9fIj . Here we define them using AC reducibility, and later we characterize them using 
generalized quantifiers. 
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Definition 2.4 (TC°, AC°(m), ACC). Let numones(z, X) be the number of elements of 
X which are less than z. 2 Then TC° is the class of relations AC reducible to numones. 
Similarly, for each m G N, m > 2, let mod m (z, X) = {numones{z, X) mod m). Then 
AC°(m) is the class of relations AC reducible to mod m . The class ACC is the union of 
all AC°(m), form>2. 

In general, each two-sorted relation class C is associated with a function class FC. A 
number function belongs to FC if it is p-bounded, and its graph is in C. A string function 
F(x, X) belongs to FC if it is p-bounded, and its bit graph (|2.1j) is in C. 

Lemma 2.5. FTC is the class of functions AC reducible to numones. Form eN,m>2, 
FAC°(m) is the class of functions AC reducible to mod m . FACC is the class of functions 
AC reducible to mod m , for some m. 

Another characterization of TC° is as follows. Consider augmenting the current two- 
sorted logic with the counting quantifier, i.e., 

3s z < tip(z, x, X) 

is a formula which is true if and only if there are exactly s values of z such that <p(z, x, X) 
is true. It has been shown Ngu04[ Theorem 2.9] that TC° is exactly the class of relations 



B COUNT 

represented by S ' formulas, i.e., bounded formulas which allow only number quan- 



tifiers and the counting quantifier. The proof in Ngu04| is based on the characterization 
of TC° BIS90 : TC° = FO(COUNT). It shows how to translate FO(COUNT) formulas 

■ , ^B, COUNT f , , - 

into 2jq formulas, and vice versa. 

2.3. The Threshold Quantifier and Threshold Operation. Observe that the counting 
quantifier as discussed above "counts" exactly the number of z's that make f>(z) true. We 
now define the threshold quantifier, which has syntax 

3^s z < t<p(z) (2.3) 

where s, t are terms not containing z. (The variable z is bound by the quantifier.) The 
semantics is given by the condition that (|2.3|) holds if and only if there are at least s values 
of z less than t that make ip true. This is similar to the counting quantifier, but we find the 
threshold quantifier more convenient, and will use it here. 

Let Y!iQ ,Th be the class of formulas built in the same way as 5]^, except now we allow 
threshold quantifiers in addition to bounded number quantifiers. The following result and 
its corollary provide interesting characterizations of TC°, but they are not used in the rest 
of this paper. 

D B Th 

Theorem 2.6. TC is the class of relations represented by S ' formulas. 

Proof. First, let ip(x,X) be a S^'™ formula. We will prove by induction on the structure 
of ip that it represents a TC° relation. The base case where <p is an atomic formula is 
straightforward. For the induction step, consider the interesting case where 

<p(x, X) = 3-s z <t <p'(z,x,X). 

By the induction hypothesis, (p'(z,x,X) represents a TC° relation. In other words, it 
represents the same relation as some ({ numones, F\, F n }) formula ip{z,x,X), for 

2 Thus the number of elements of X is numones ( \X \, X). 
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a sequence Fi,...,F n of string functions satisfying (|2.2|) . Let F n+ ± be £jf -definable from 
{numones, Fi, . . . , F n } as follows: 

F n+ i(x,X)(z) o z < t A ip(z,x,X). 

Then </? represents the same relation as the formula 

numones(t, F n+ i(x, X)) > s. 

For the other direction, we will prove by induction on n > a stronger result: 
If F\, . . . , F n is any sequence of string functions satisfying (|2.2|) (with C = {numones}), 
then for any S ' T ({numones, F±, F n }) formula ip(x,X) there is a Y,Q ,Th formula 
(p(x, X) that represents the same relation. (*) 

a) For the base case, we prove by induction on the structure of a X! Q ,Th (numones) 
formula ip that there is a X^' 771 formula (p that represents the same relation as ip. It suffices 
to show that any atomic formula ip(numones) (i.e., ip contains numones) is equivalent to a 

numones (ti, Xi), . . . , numones(t m , X m ) 

be all occurrences of numones in ip, enumerated in some order such that if numones (ti, Xi) 
is a sub-term of tj then i < j. Let u\, u m be a list of new variables. Let be the result 
of replacing each maximal sub-term numones (ti, Xi) of tj by Uj and let ^' be the result of 
replacing each maximal sub-term numones (ti, Xi) in ip by Ui. Note that if m occurs in t'- 

B Th 

then i < j. Now the Xl ' formula p is 

m 

3u! <t[... 3u m < 4, V' A /\ [3^n fc z < t' fe X fe (z) A ^(u k + 1) z < t' k X k (z)}. 

k=l 

b) For the induction step, suppose that F n+ \ is S^-definable from {numones, F\, F n } 

B Th 

(for n > 0). Let ifi be a S ' ({numones, F%, F n +i}) formula. We will show how to 
eliminate F n+ i from ip by induction on the depth of nesting of F n+ \ in ip. 

For a term or formula u>, we define d(u) to be the maximum depth of nesting of any 
occurrence of F n+ i in u. 

We will prove the following by induction on k > 0: 

If d(ip) = k, then there is a 'S^ ,Th formula cp that represents the same relation as ip. 

(i) The base case where k = follows from the induction hypothesis of (*), since there 
is no occurrence of F n+ \ in ip. 

(ii) Suppose that (**) holds for all ip where d(ip) < k. It suffices to prove (**) when ip 
is an atomic formula, and d(ip) = k + 1. 

Let F n+ i(r\, T\), . . . , F n+ i(r£, Tg) be all string terms in ip of the form F n+ \(r, T), where 
d(F n+1 (f,f)) = k + l. (Thus max({d(r) \ r G n} U {d(T) \ T G f t }) = k, for i = 1,... ,£.) 
Let Wi, ...,Wi be new string variables, and let ip' be the formula obtained from ip by 
replacing each F n+ \(fi, Ti) with Wj, i = 1, Then ip' is atomic, since ip is atomic. Since 
c^VO ^ fc) it follows by the induction hypothesis that there is a Xl^'^ formula that 
represents the same relation as ip' . Then each Wi can occur in 9 only in the form \Wi\, or 
Wi(r), for some number term r (r might contain some |Wj|'s). 

Suppose that F n+ \ is defined by 

F n+1 (x,X)(z) <h> z < t n+ i(x,X) A tp n+ \(z,x,X) 
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where t n+ \ is a term in the base language C\ and tp n +i is a ({numones , F\, F n }) 
formula. Now each occurrence of \Wi\ in 9 can be eliminated by the equivalence 

\F n+ i(fi,fi)\ = Zi <-> Si 

where zi, —,Zi are new number variables and (setting t[ = t n +i(?i, Tj)) 

<5i = 2i < t'i A [Vx < t-, i > Zj D ->tp n +i(x,fi,Ti)] A [zj > D - 1,^,7})] 

(Note that d(y? n +i(,z, fj, Tj)) < fc.) Let 0' be obtained from # by replacing each \Wi\ by Zj. 
Let 0" be the formula 

3z 1 <t[... 3z e < t' e (0' A St A ... A <y 
Next, replace each occurrence of the form Wi(r) in 8" (such r does not contain any of the 
Wj's) with 

r < t[ A (/J n+ i(r,ri,Ti). 

Let 6"' be the resulting formula. Then 0"' represents the same relation as tj). Since d(0"') < 
k, we can apply the induction hypothesis to 6"' to obtained the desired J^Q ,Th formula ip 
that represents the same relation as ip. □ 

Define the threshold operation as follows. It takes a relation Q(z) (which may contain 
other parameters) to the relation \ThzQ](k,y) defined by 

[ThzQ](k,y) ^ there are at least k values of z < y that satisfy Q(z). 

Then the threshold and Boolean operations together simulate the bounded number quan- 
tification operations. For example, the relation [3z < tQ]{z) is the same as the relation 

[ThzQ](M). 

The following is immediate from Theorem 12.61 

Corollary 2.7. TC° is the closure of AC relations under the threshold and Boolean 
operations. 

2.4. The Modulo m Quantifier and Operation. For each m € N, m > 2, the modulo 
m quantifier and modulo m operation can be defined similarly as the threshold quantifier 
and threshold operation, with a little more complication (see PW85 ). In particular, the 
modulo m quantifier Mod m only makes sense when the variable it quantifies over is bounded. 
Thus, 

Mod m z < t tp(z) 

is true if and only if the number of z < t satisfying <p(z) is exactly 1 modulo m. Similarly, 
the modulo m operation takes a relation Q(z,x,X) into the relation [Mod m zQ](y , x , X) 
which consists of all tuples (y,x,X) such that 

\{(z,x,X) : z < y and Q(z,x,X)}\ = 1 mod m. 

Let 5]^' Modm formulas be bounded formulas in our two-sorted logic augmented with the 
Mod m quantifier, where only bounded number quantifiers are allowed. Then the analog of 
Theorem 12.61 and Corollary 12 . 71 can be proved by slight modifications of the original proofs. 

Theorem 2.8. For each m € N, m > 2, AC°(m) is the class of relations represented by 
' ° m formulas. It is also the closure of AC relations under Boolean, bounded number 
quantification and modulo m operations. 
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3. The Theories 



3.1. The Theory V°. We start by describing the theory V° |Cool ICoo05| for the com- 
plexity class AC . All of the theories that we introduce here are extensions of V° . 

The theory V° has underlying language C 2 A and is axiomatized by the set of axioms 
2-BASIC and the S^-COMP axiom scheme. First, 2-BASIC is the set of the axioms 
Bl - B12, LI, L2 and SE below. 



Bl. i + l^O 

B2. x + l=y+lD x = y 
B3. x + = x 

B4. x + {y + 1) = (x + y) + 1 
B5. x • = 

B6. x • (y + 1) = (x ■ y) + x 
LI. X(y) Dy < \X\ ' 



B7. (x < y A y < x) D x = y 
B8. < x 

B9. x<yAy<zDx<z 
BIO. x < y V y < x 
Bll. x<y<^>x<y+l 
B12. x / D By < x(y + 1 = x) 
L2. y + 1 = \X\ D X(y) 



SE. X = Y <-> [\X\ = \Y\ A Vz < \X\(X(z) <-> Y(z))} 



The axiom scheme Sq-COMP is the set of all formula of the form 

3X < a\/z < a, X(z) «-► <p(z), (3.1) 

where tp is a Xl^ formula not containing A". 

Although V° does not have an explicit induction scheme, axioms LI and L2 tell us 
that if X is nonempty then it has a largest element, and thus we can show that V° proves 
the A-MIN formula 

< \X\ d 3x < \X\(X(x) A Vy < x ^X(y)) 

and X-IND 

[X(0) A Vy < Z (X(y) D X(y + 1))] D X(z) 
From this and S^-COMP we conclude that V proves the scheme 

5^-IND: [<p(0) A \/x(<p{x) D (f{x + 1))] D Vz<p(z) 

where (p(x) is any formula (possibly containing parameters). 

A pairing function can be defined in V° by using (x, y) to abbreviate the term [x + 
y){x+y+l) + 2y. Then V° proves that the map (x, y) i— > (x, y) is an one-one map from Nx N 
to N. We use this idea to define a binary array X using the definition X(x, y) = X((x, y)). 
By iterating the pairing function we can define a multidimensional array X{x). Then V° 
proves the corresponding comprehension scheme 

3Z < (a)\/z < (a), Z(z) <-» <p(z) 

for any 5]^ formula ip. 

If we think of Z as a two-dimensional array, then we can represent row x in this array 
by Z^ x \ where = Row(x,Z) is the FAC° string function with bit-defining axiom 

Z [x] (i) w Row(x,Z)(i) ^i<\Z\A Z(x,i) (3.2) 

Lemma 3.1. Let V (Row) be the extension of V° obtained by adding the function Row 
with defining axiom V3. fy) . Then V°(Row) is conservative over V°, and every Yi^(Row) 
formula (p is provably equivalent in ~V°(Row) to a formula ip' . 
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Proof. Conservativity follows from the fact that Row is £f -definable in V°(see Lemma 

For the second part, we may assume by the axiom SE that (p does not contain = 2 . We 
proceed by induction on the maximum nesting depth of Row in ip. It suffices to consider 
the case in which ip is atomic. If tp has the form Row(t, T)(s), then <p is equivalent to T(t, s) 
which by the induction hypothesis is equivalent to a formula. 

Now suppose that (p is atomic and does not have the form Row(t,T)(s). Let 

Row{tx,T x ), ...,Row(t k ,T k ) 

be the maximal depth string terms occurring in ip. Then each such term Row(ti,Ti) must 
occur in the context | Row (ij, Ti)\, so 

ip = ip'{\Row(ti,Ti)\, \Row(t k ,T k )\) 

where ip'(xi, ...,x k ) has less -Row-nesting depth than ip. Then V (Row) proves 

k 

ip <-> 3xi < \Ti\..3xk < \T k \, (f\ row-length(xi,ti,Ti)) A <p(xi, x k ) 

8=1 

where row-length(x,y, Z) is a formula expressing the condition x = \Row(y, Z)\. We 
can now apply the induction hypothesis to the RHS. □ 

3.2. The Theory VTC°. The theory VTC° is V° together with NUMONES, which is 
essentially a Xlf defining axiom for numones (Definition I2.4JI . Let ipNUMONEs(X,Y) be 
the "Sq formula stating that Y is a counting array of X, i.e., for each z < \X\, Y(z, y) holds 
if and only if numones(z, X) = y: 

<P numones (X,Y) = [Vz < \X\3ly < \X\Y(z,y)] A Y{0,0) A 

Vz < \X\Vy < \X\, Y(z, y) D [(X(z) D Y(z + 1, y + 1)) A (^X(z) D Y(z + 1, y))}. (3.3) 

Definition 3.2. Let NUMONES denote VX3Yip NUM ONEs(X, Y). The theory VTC° is V° 
extended by the axiom NUMONES . 

Note that V° proves that NUMONES implies that same axiom with 3Y replaced by 
the bounded quantifier 3Y < 1 + (\X\,\X\). Hence VTC° is equivalent to a theory with 
bounded axioms. 

Lemma 3.3. The theories V° and VTC° are finitely axiomatizable. 

Proof. The finite axiomatizability of V° is proved in |CK03| . The theory VTC° is the 
result of adding a single axiom to V°. □ 

The next definition refers to the notion of formula, defined in Section [2.11 

Definition 3.4. Let T be an extension of V° over a language C A string function F(x, X) 
is T\(C) -definable in T if it satisfies 

Y = F(x, X) «-» ip(x, X, Y) (3.4) 

for some T,\(C) formula ip, and 

T h \/x\/X3\Y<p(x, X, Y) (3.5) 
The T,\(C)- definability for a number function f(x,X) is defined similarly. 
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Lemma 3.5. If T is an extension of V° which satisfies 13. .5)) and F is not in the language 
of T and T is the result of adding F to the language and adding {3.$ us an axiom, then 
T is a conservative extension of T. 

Proof. According to (|3.5j) . every model of T has an expansion to a model of T which 
satisfies (j33J. □ 

If T is a bounded theory, in the sense that the quantifiers in the axioms for T can be 
bounded by terms of C 2 A , then by Parikh's Theorem |Par71llCoo| it follows that a function 
is definable in T iff it is Y<f definable in T. 

We can now state one of our main results, which explains the sense in which our theories 
characterize the corresponding complexity classes. We already know |Coof )5 that the In- 
definable (and hence the S^)-definable functions in V° are precisely those in FAC°. 

Theorem 3.6. The T,\-definable (and the -definable) functions in VTC° are precisely 
those in FTC . 

The proof is the subject of Subsections 13.31 - 13.51 

3.3. Universal Theories. We will employ the techniques from |.Coo05] to develop the 
universal version of our theories. The idea is to introduce Skolem functions which are 
provably total in the theories to eliminate the quantifiers. Note that the axioms B12 and 
SE are not universal statements. As in jCoo05j . B12 is replaced by B12' and B12" below. 
Consider the number function pd where pd(x) is the predecessor of x. Then B12' and B12" 
are the defining axioms of pd: 

B12' pd(0) = B12" i/OD pd{x) + l = x (3.6) 

The left-to-right direction of SE can be expressed by an open formula simply by re- 
placing Vz < \X\ by z < \X\ D: 

SE' : X = Y D [\X\ = \Y\ A z < \X\ D (X(z) <-» Y{z))\. 

The right-to-left direction of SE has an implicit quantifier 3z < \X\. We can get rid of this 
by using the function /se (which is f a> t in Definition 13.71 below, when a = X(z) <A Y(z), 
and t = \X\): 

fsE(X,Y)<\X\, (3.7) 

z < \X\ A (X(z) t4 Y(z)) D X(f SE (X, Y)) Y(f SE (X, Y)), (3.8) 

z < /se(A, y) D X(z) <-> Y(z). (3.9) 

Thus /se(A, Y) is the smallest number < |A| which distinguishes X and Y, and |X| if no 
such number exists. Let SE" be 

SE" : (|X| = |F| A / SE (A, Y) = \X\) D X = Y. 

Definition 3.7 (£fac )" ^fac° ^ s ^ e sma ^ es t class that satisfies 

a) >C FAC o includes C\ U {pd, /se}- 

b) For each open formula a(z,x,X) over C FAC o and term t = t(x,X) of C 2 A there is a 
string function F a j of £ FAC o with defining axiom 

F a}t (x,X)(z) < t Aa(z,x,X) (3.10) 
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c) For each open formula a(z,x,X) over C FAC o and term t = t{x,X) of C 2 A there is a 
number function f a ^ with defining axioms 




Note that f a j(x,X) = minz < ta(z,x,X) and 




We define the theory V |Coo05| to be the universal theory over £ FAC o whose axioms 
are the universal closures of the following list of open formulas: Bl - Bll, B12', B12", 
LI, L2, SE', SE", the defining axioms (J3~7|) . (|3T5|). (j33|) for / SE , and the defining axiom 
(|3.1U|) for each function F a j and defining axioms (|3.11|) . (|3.12|) . (|3.13|) for each function f a ^. 

Lemma 3.8. For every formula ip there is an open formula a of J~- FAC o such that V° 

proves (ip <-> a). For every open formula a of C FAC o there is a formula if such that V° 
proves {ip <-> a). 

Proof. The first sentence follows by structural induction on formulas </?, using ()3. 14|) . To 
prove the second sentence consider an enumeration of the new function symbols of C FAC o 
in some order such that the defining axioms of each function in the list mention only earlier 
functions in the list. Now show by induction on k that if a only involves functions occurring 
in the first k positions on the list then a is equivalent to some formula ip. □ 

Theorem 3.9. V° is a conservative extension of V°. The function symbols in C FAC o 
represent precisely the functions in FAC°. 

Proof. To show that V° extends V° it suffices to show V° proves the Sq-COMP axioms 
(|3.1I) . Prom the first sentence of Lemma 13.81 and (j3.1Uj) we have that for every formula 
(p(z, x, X) there is a function F in C FAC o such that 



from which (|3,lj) follows. 

To see that the extension is conservative we can prove by induction that the functions in 
£ FAC o are Sf -definable in V°. Here we enumerate £ FAC o so that each function is defined 
from earlier functions in the enumeration, starting with pd, fsE an d Row. The main step is 
to show that the quantifier-free defining axiom for the (n + l)-st function can be translated 
into a Ylf(C\) defining axiom in V°. Finally it is clear from Definition 13 . 71 that the function 
symbols in C FAC o represent precisely the functions in FAC°. □ 

It is worth emphasizing that V° proves the S^-IND and S^-MIN schemes, since it 

extends V°. This is true even though V has purely universal axioms, and has no explicit 
induction axiom or rule. 

Below we prove the General Witnessing Theorem for universal theories (Theorem l3.2()|) . 
The Witnessing Theorems for our theories will follow from those of their corresponding 
universal conservative extensions. It follows that the 3gE;f-definable functions in these 
theories are in the appropriate complexity classes. For the other direction, it is clear that 



VV F(x,X)(z) 



<->z<«A tp(z, x, X) 
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the universal theories define all functions in the appropriate classes, and Theorem 13.151 
below shows the same for the original theories. 

3.4. The Theory VTC . The function numones from Definition 12.41 has defining axioms 

numones(0, X) = (3.15) 
X(z) D numones(z + 1, X) = numones(z, X) + 1 (3.16) 
—>X(z) D numones (z + 1, X) = numones (z, X). (3-17) 

Since 

y = numones(x, X) <-> 3Y, (Pnumones(X, Y) A Y(x, y) (3.18) 
it is easy to see that numones is ^f- definable in VTC U . 

The vocabulary £ FTC o includes numones and is intended to represent the functions in 
FTC . 

Definition 3.10. £ FTC o is defined in the same way as C FAC o (Definitional^ with (a), 
(b) and (c) replaced by 

(a' ) £ FTC a includes L\ U {pd, /se, numones}, 

(b '), (d ) are the same as (b), (c), except that C FAC o is replaced by £p T co- 

The next lemma follows directly from the definitions. 

Lemma 3.11. The functions in C FTC o represent precisely FTC . A relation is in TC° if 
and only if it is represented by some open C FTC o formula. 

Definition 3.12. VTC° is the universal theory over £ FTC o whose axioms are the universal 
closures of the following list of open formulas: Bl - Bll, B12', B12", LI, L2, SE', SE", 
the defining axioms ()3.7j) . (|3.8[) . (j3.9j) for fs F , the defining axioms (|3.15|) . ()3.16() . (|3.17|) 
for numones, and the defining axioms ()3.1fl|) and (|3,11|) . (|3.12|) . ()3.13|) for the functions of 
C FTC o. 

The first part of the analog of Lemma 13.81 is easily shown to hold in this context. 

Lemma 3.13. For every 5]^ (numones) formula ip there is an open formula a of £ FTC o 
such that VTC° proves (99 «-> a) . 

From this we can show the following. 
Lemma 3.14. VTC° extends VTC . 

Proof. Since VTC° extends V°, it suffices to show VTC° proves NUMONES. We show 
this by pointing out that £pxc° includes a string function Fnum such that VTC proves 

y = Fnjjm(X) D (fNUMONEs(X, Y). 

We can define Fj^um by the condition 

Fnum(X)(z, y) «-> z < \X\ A y = numones(z, X). 

We can turn this into a proper bit-graph definition 1)3.10(1 by using a (numones) formula 
and appealing to Lemma T3. 131 □ 
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Unfortunately the analog of the second sentence of Lemma 13.81 does not appear to 
hold. In general an open formula of £ FTC o is not equivalent to a YiQ(numones) formula 
for the same reason that a TC° circuit involving nested threshold gates cannot be made 
polynomially equivalent to a circuit with unnested threshold gates. Hence we must work 
harder to prove that VTC is conservative over VTC°. 

To prove conservativity, we note that VTC can be obtained from VTC (numones) 
by successively adding Sj^-definable functions and their definitions. This fact together with 

Lemma 13 . 1 61 and the following theorem are used to show both that VTC° is conservative 
over VTC and that all functions in FTC are 5^-defmable in VTC (Corollary IHUHJ) • 

Theorem 3.15. Let T be an extension of V° with a vocabulary C which includes the 
function Row, and suppose that T proves the defining equation \3. g)) for Row. Suppose that 
T satisfies 

a) T proves the S^(£)-COMP scheme, and 

b) For each Jjq(C) formula a there is a formula (3 such that T h a <-> f3. 

Let £ extend C by adding a function symbol that is Eq -definable from £ (see Defini- 
tion \2. ty) . Let T be obtained from T by adding the function symbol and its defining axiom. 
Then T' is conservative over T, and a) and b) hold with T replaced by T and C replaced 
by C. 

Proof. We will consider the case C! = C U {F}, where F is a string function definable 
from £, i.e., it has the defining axiom 

F(x,X)(u) ^ u < t(x, X) A <p(u, x, X) (3.19) 

for some C\ term t and Y1q(C) formula <p. The case in which £ extends £ by a number 
function is handled similarly, except that number variables W{ are used instead of the string 
variables Wi in the argument below. 

Since T proves the S^(£)-COMP scheme, it follows that it Ef (£)-defines F. There- 
fore T is conservative over T . 

a) We will show that T proves a slightly modified version of the comprehension axiom 

3Z < (6}Vz < 6, Z(z) <-> i){z) (3.20) 

for each J}q(C) formula ip, where z are all number free variables of ip. It is straightforward 
to obtain the usual comprehension axiom scheme from this. Also, since T extends V°, it 
proves this version of £^(£)-COMP. We will prove (|3.2()|) by induction on the quantifier 
depth of ip. 

For the base case, ip is quantifier-free. Suppose that F(s\, T\ ),..., F(sk, T^j are all 
occurrences of F in ip. Note that the terms s*j,Tj may contain z as well as F. Assume 
further that S\,T\ do not contain F, and for 1 < i < k, any occurrence of F in s*i,Tj must 
be of the form F(sj,Tj), for some j < i. We proceed to eliminate F from tjj by using its 
defining axiom ()3.19|) . 

Let W\, Wk be new string variables. Let (pi(z, u) = (p(u, s±, Ti), and for 2 < i < k, 
y>i(z, u) is obtained from ip(u, Si,Ti) by replacing every maximal occurrence of any F(sj, Tj), 
for j < i, by W^. Let U be obtained from £(sj,Tj) by the same procedure (for i < k). Thus 
F does not occur in any y?j or ti. Since T proves Sq (£)-COMP, it proves the existence of 
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Wi such that 

Vz < b, w\ A (u) ^u<t { A ifi(z, u) for 1 < i < k. (3.21) 

Let ip'(z, W\, . . . , Wk) be obtained from ip(z) by replacing each maximal occurrence of 
F(si,fi) by w\ A , for 1 < i < k. Then, by S^(£)-COMP and the fact that C contains 
Row, 

Th3Z< (b)Vz<b, Z(z) <-> i//(z,Wi,...,W k ). 
Then such Z satisfies Vz < b, Z(z) <-> ip(z) when each Wi is defined by 1)3.21(1 . 

For the induction step, it suffices to consider the case ifi(z) = Vx < tip'(z,x). By the 
induction hypothesis, 

T h 3Z' < (b, t)Vz < b\/x < t, Z'(z, x) <p'(z, x). 
Now, by S^-COMP, 

V°h3Z < (b)\/z< b, Z(z) <-> Vx < tZ'(z,x). 

b) Suppose that 

a = Qizi < n . . . Q n Zn < r n ip{z) 
is a 'Eq(C) formula, where ip is quantifier- free. Let tp'(z, Wi, . . . , Wk) be obtained from 
i/j(z) as described above in the proof of a). Define 

a'(Wx,...,W k ) = Qizi < n...q n z n < r n il)'{z,Wi,...,W k ). 
For 1 < i < k let 7, be the formula (j3.21() . Then, a is equivalent in T' to 

3Wi < (f, ti) . . . 3W fc < (r, 4), (/\ 7i ) A a'(Wi, . . . , W fc ). 

By property b) for T we may replace the part of the above formula following the string 
quantifier prefix by a formula, and thus we obtain the required formula j3 in c) for 
T. □ 

Let VTC° (Row , numones) be VTC° together with the functions Row and numones 
and their defining axioms 1)3.2(1 . 1)3.15(1 . ()3.16j) . 1)3.17(1 . Since both Row and numones are 
Sj^-definable in VTC° it follows that ~VTC°(Row, numones) is conservative over VTC°. 

Lemma 3.16. Let T be the theory VTC° (Row, numones). Then T satisfies hypotheses a) 
and b) in Theorem \S.l5\ 

Proof. First note that VTC° (Row) satisfies a) and b) by Lemma 13.11 We will prove the 
present lemma by modifying the proof of Theorem 13.151 applied as if T is 
VTC° (Row, numones and T is VTC°(Row). 

Proceeding as in the proof of a), we want to show that T proves ()3.2(J() where ip(z) is 
a Sq '(Row , numones) formula. Arguing as before, it suffices to consider the base case of 
the induction, where ip is quantifier-free, and numones plays the role of F in the previous 
argument. Thus numones (s\,T\), numones (sfc,Tfc) are all occurrences of numones in ip, 
ordered as before. We proceed to eliminate the occurrences of numones from t/j using ()3.18() . 

Let w\,...,Wk be new number variables. Let s'i = s%, and for 2 < % < k let be 
obtained from Sj by replacing every maximal occurrence of numones (s j ,Tj), for j < i, by 
Wj. Let T[ be obtained from Tj in the same way. (Thus numones does not occur in any 
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of the Sj's and Tj's.) Let Yi,...,Y k be new string variables. By Claim 13.171 (below), for 
1 < i < k, VTC° (Row) proves the existence of Y{ such that 

\/z < bMwi < s[..Mw k < s' k <pnumones{T(,y} z ' w] ). (3.22) 

If Yi,...,Yfc each satisfies (|3.22p . and wi,...,Wk each satisfies Y i (s'^Wi) then by (|3.18() 
each Wi must have its intended value numones (si,Ti). Thus VTC°{Row , numones) proves 
k k 

Vz < b\/w < s', ( f\(ip numones {T(,Y} z ' w] ) A Y} z,w \s' i ,w i )) D f\wi = numones (si,Ti) 
i=i i=i 
Let ip'(z,wi, ...,Wk) be obtained from ij){z) by replacing each maximal occurrence of 
numones (Si, Ti) by uii, for 1 < i < k. Then by (Row)-COMP we have V°(Row) proves 

3Z < (b)W< b, Z(z) <-» 3 Wl < s[..3w k < s' k , (/\Y}^ ] (s' i ,w l )) A tf%w u . . .,w k ). 

Then such Z satisfies \/z < b, Z(z) <-» ^(.z) when each Yj satisfies (13.22(1 . 
To prove b), suppose that 

a = Q 1 z 1 < n . . . Q„z„ < r n ip(z) 

is a numones) formula, where ip is quantifier-free. Then, using the notation of 

the proof of a) above, VTC° (Row, numones) proves 

a <-» 3Y < £ 

(Vz < 6VuJ < P /\ ipNUMONEs(Tl, Y}^ ] )) A Qz < r3w < s', ^'(z, w)A/\ Y} zM (s' i ,w i ) 

for suitable terms t bounding Y. The RHS is a Ylf(Row) formula which, by Lemma 13. II is 
equivalent to a formula. □ 

To complete the proof of Lemma 13.161 we show that for 1 < i < k, VTC° proves 
the existence of Yi which satisfies (|3.22(l . It suffices to show that VTC° (Row) proves the 
existence of multiple "counting arrays" for polynomially many strings. 

Claim 3.17. The theory VTC° (Row) proves the existence of Y such that 

Vu<bVNUMONEs(X [u \YW) 

Proof. We construct (using S^(i?o«i)-COMP) multiple counting arrays Y^\ . . . , Y^ 6-1 ! 
from the counting array Y' for a "big" string X' , which is obtained from the strings 
. . . ,X^^ simply by concatenating them. More precisely, let X' be defined by 

X'(u\X\+x) <-» X [u] (x), for x < \X\,u< b. 

Thus X'(u\X\), . . . ,X'((u + 1)|X| - 1) is a copy of XH Therefore 

numones (z, X^) = numones(u\X\ + z, X') — numones (u\X \, X'). 

Let Y 1 be the counting array for X', i.e., Y'(z,y) <^ numones(z, X') = y. Then 
Y^- U \z, y) 44> y = numones(u\X\ + z, X') — numones (u\X \, X'). Hence 

Y^(z,y)^3 yi ,y 2 < \X'\, Y'(u\X\, yi ) A Y'(u\X\ + z, y 2 ) A y + yi = y 2 

□ 

Corollary 3.18. VTC° is a conservative extension o/VTC°. Every function in £ FTC o 
is ^{-definable in VTC°. 
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Proof. VTC (Row, numones) is conservative over VTC because Row and numones are 
Sf -definable in VTC . According to Lemma f3. 161 and Theorem 13,151 VTC° is the union 
of a sequence of conservative extension of VTC (Row, numones) satisfying a) and b). Thus 
(by compactness) VTC is conservative over VTC . Each of these extensions is obtained 
by adding a 5]^(jC)-definable function. The graph of each such function has a Sf^(£) 
definition, which by b) is provably equivalent to a ~Sf formula (in the language of VTC ). 
Hence this function is E;f -definable in VTC° and hence in VTC . □ 

The above corollary proves one direction of Theorem 13.61 for the case of VTC . For 
the other direction we need witnessing theorems, which are the subject of Subsection 13.51 

Recall that each string function F S FTC has a defining axiom according to our 
construction of £ FTC o (see Definition I3.1UI and Lemma I3.11|) . In fact, there is a finite 
sequence of FTC functions F\, . . . ,F n that are involved in defining F. Let C(F) denote 
this sequence of functions (including F), and let £(F)-AX be the set of their defining 
axioms. The following corollary is proved similarly to Corollary 13.181 

Corollary 3.19. For each F G FTC , VTC is a conservative extension of the theory 
VTC U£(F)-AX. 

3.5. Witnessing Theorems. In this subsection we will prove the remaining direction of 
Theorem 13.61 namely that the 5] {-definable functions in each of our various theories are in 
the appropriate complexity class. 

We will use the proof system LK 2 |Cooj which extends LK (see e.g. Bus98a]) by the 
introduction rules for string variable quantifiers. It is convenient to distinguish between 
bound variables (which are denoted by x,y, z, . . . for number variables, and X, Y, Z, . . . for 
the string variables) and free variables (which are denoted by a,b,c, . . . for number variables, 
and a,/3,7, . . . for the string variables). Recall the definition of £ FAC o in Definition 13.71 

Theorem 3.20 (General Witnessing Theorem). Suppose that C extends £ FAC o and that it 
satisfies conditions b, c in Definition \3. 7| with £ FAC o replaced by C Suppose that T is an 

open theory extending V° and that T contains the defining axiom (|3.10f) for each function 
F a j of C, and the defining axioms (|3.11|) . (j3.12|) and (j3.13|) for each function f a<t of C. 
Then for each theorem 3Z<p(a, a, Z) of T , where (p is a gXlf formula, there are functions 
F of C such that 

Th VxVX ip(x,X,F(x,X)). 

Proof. Note that when ip is an open formula, the Theorem is an application of Herbrand 
Theorem. To prove the current Theorem for the general case we will follow the proof 
theoretic approach and examine the LK 2 -T proofs (i.e., proofs in LK 2 with non-logical 
axioms from T). In particular, we will explicitly witness the string existential quantifiers in 
every line of an anchored |Bus98al ICooj (also known as a free-cut free) proof of 3Zip(a, a, Z) 
by functions from C. This is explained below. First, the following Claim will simplify our 
arguments. 

Claim: For each Yl^(C) formula (j)(x,X), there is an open formula ip(x,X) of C such 

that 

Th^(x,X) <-» (j>(x,X). 
Note that on page 1111 we have used fsE to eliminate an implicit quantifier 3z < \X\ in 
the axiom SE. The proof of this Claim is similar and is omitted. 



18 



PHUONG NGUYEN AND STEPHEN COOK 



Now for simplicity, assume that we are to witness a single variable Z in 3Ztp(x, X, Z), 
where ip is a gSf formula in prenex form. Consider the most interesting case when <p is of 
the form: 

(p(a, d,Z) = \/y n < b 3Y n <b ... Vyi <b3Y 1 <b 9(3, a, y, Y, Z) (3.23) 

By the above Claim we can assume that 9 is an open formula of C. 

An anchored \jK. 2 -T proof 7r is a proof in the system LK 2 with additional non-logical ax- 
ioms the instances of axioms of T, and the cut formulas of tt are restricted to these instances 
only. By a standard argument, there exists an anchored LK 2 -T proof tt of 3Z tp(a, a, Z). 
Since T is an open theory, the cut formulas in tt are quantifier- free. Thus quantified formu- 
las in 7r can appear only in the succedents, and must be of one of the two forms below (we 
will not mention the bound b on variables) 

Vj/i 3Y\ 9(3, a, Y m ,...,Y 1 ,T) 

(3.24) 

\/y m 3Y m ... Vyi 3Y 1 9(3, OL , C n , . . . , C m _|_ 1 , y m , . . . j J/1 j r n , . . . , Tm+ 1 ; 

(3.25) 

(q's are free number variables, and T, Tj's are string terms which do not involve bound 
variables y^s and ij's). Therefore the only quantifier introduction rules can be used in tt 
are the number V-right rule and the string 3-right rule. Also, the A, V and -i introduction 
rules can only be applied to quantifier-free formulas. 

We will prove by induction on the length of tt that for each sequent S of tt, there are 
functions Fj's of C (called the witnessing functions of S) so that the sequent S' , which is 
constructed from S and F^s as described shortly, is a theorem of T. Essentially Ffs are 
the witnessing functions that compute the existentially quantified string variables of S, and 
S' is constructed from S by explicitly mentioning these witnessing functions. Suppose that 
S = A — ► r (note that A contains only open formulas), then S' = A — ► V , where V 
consists of the following (quantifier-free) formulas. (We drop mention of a, a in 9 as well as 
in FiS. Note that the functions Fj's may contain free variables that are present in S. We 
write cj i>fe ] for a, . . . , c k , and similarly for and Xj ijfc ].) 

• All open formulas in T 

• For each formula of the form ()3.24|) in T, the formula 

^(c[n,m]>^[m-l,l]i I1 [ii,m+l]i'Pm(c[n,m])> ■ ■ ■ >Fl(c[n,m]>b[ m -i t i]),T) (3.26) 

• For each formula of the form ()3.25|l in V, the formula 

^{c[ n ,m+i},b[ mt i],T[ njm+1 ],F m (c[ n!m+1 ],b m ), . . . ,i ? i(c[ n)m+1 ],6[ m>1 ]),T) (3.27) 

(In (|3.26|) and (|3.27|) . the free variables 6j's do not appear anywhere else in S'.) 

The base case holds trivially, since the axioms of T are open formulas. For the induction 
step, we consider the inference rules that might be used in tt. 

Case I (String 3-right): Suppose that S is the bottom sequent of the inference 

A^r,v(r m+1 ) 

~S ~ A — T, 3Y m+1 ip{Y m+1 ) 

where ip is as (|3.25p . By the induction hypothesis, S[ is a theorem of T. We obtain S' from 
5{ by taking F m+ i to be the function defined by T m+ i. 
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Case II (Number V-right): Note that this rule can be applied to only formulas of the 
form (|3.24|) . Also in this case, the free variable c m must not appear anywhere else in S. 
In the witnessing functions that occur in (|3.26|) . c m is replaced by b m . No new function is 
required. 

Case III (Cut): Note that the cut formula is an open formula. Suppose that S is 
derived from Si and S2 using the cut rule: 

Si s 2 a — ► r, v a, V — ► r 
s a — ► r 

where ifi is an open formula of C. The witnessing functions of S is defined from the witnessing 
functions of Si and £2 as follows: 

Fi(z) <->(-.^Ai?(*)) V OjAF^(z)) 
Case IV (Weakening rule): If S is obtained from Si by the weakening rule, then S' 
can be obtained from S[ by the same rule. When the additional formula in S is a gSf 
formula (of the form (|3.24j) or (|3.25|l ). the witnessing functions can be the constant string 
function 0. 

Case V (Contraction rule): Suppose that S is derived from Si using the contraction 
rule. Consider the interesting case where the formula removed from <Si is a gS;f formula. 

Si A — >T,i()(a,a,c),il)(a,a,c) 
S A — ► T, ip(a, a, c) 

(ip(a,a,c) is of the form (|3.24|) or (|3.25jl ). Note that the two occurrences of ip in Si may 
have different collections of witnessing functions in S[. However, if \/zip(a,a, z) is to be 
true, then at least one of the two collections is correct. The witnessing functions in <S' are 
defined using this information. 

Formally, consider the case of ([3.24ft . and assume that corresponding to the two occur- 
rences of ip(a,a,c) in S\, we have the following formulas in S[ (see (|3.2fi)) ): 

9\c, b) = 6(c, b, f, Fi(c), F}(c, b)) 

6 2 (c, b) = 8(c, b, f,Fl(c),..., F?(c, b)) 

In general, the witnessing functions of S' are 

Fi(c, b)(x) «-» (Vf Vy 9\z, y) A F}(c, b)(x)) V {-US Vy 9\z, y) A i^ 2 (c, b){x)) 

Case VI (Other rules): When ip is in prenex form (|3.23|) . the introduction rules for 
A, V,-> can be applied to only quantifier-free formulas. No new function is required. In 
general, handling these rules is more complicated, but is straightforward. Similarly, if iS is 
obtained from Si by the exchange rule, then S' can be derived from S[ by the same rule. □ 

Corollary 3.21 (Witnessing Theorems for VTC°). For each theorem 3Ztp(x, X , Z) of 
VTC° where (p is gSf , there are string functions F G FTC , such that 

VTC° U £(F)-AX h ip(x,X, F(x,X)). 

Proof. Suppose that VTC° h 3Zip(x,X, Z), so VTC° h 3Zp(x,X, Z). By Theorem l3~2T71 

there are string functions F G jCftc sucn that VTC° h <p{x, X, F(x, X)). The conclusion 
follows from Corollary 13.191 □ 

Note that similar witnessing theorems hold for the universal theory VTC°. 
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Corollary 3.22 (The remaining direction of Theorem 13. 6)1 . The S}- definable function in 
VTC° are m FTC . 

3.6. Theories for Other Subclasses of P. In this subsection, we will apply Theorem l3.15l 

and Theorem 13 .201 to develop finitely axiomatizable theories for other uniform subclasses of 
P in the same style as VTC°. Let F be a polynomial time string function and let C be 
the class of two-sorted relations which are AC°-reducible to F. Note that the associated 
function class FC is usually defined using the graphs (for number functions) and bit graphs 
(for string functions) (page [BJ) . But it can be equivalently defined as the class of functions 
which are AC°-reducible to F. In the case of TC°, F is essentially the string function 
computing the "counting array", whose graph is given by NUMONES . 

We add to V° a Xlf axiom AXIOM p which formalizes the polytime algorithm that 
computes F. (Thus AXIOM F is a generalization of NUMONES.) We will show that the 
resulting theory T characterizes C. The proof is almost identical to the proof in the case of 
VTC°: we show that the universal theory T (obtained from C 2 A (Row, F) in the same way 

that VTC° is obtained from C\(Row, numones)) characterizes the same class. The main 
task is to prove the analogue of Lemma 13. 161 i.e., T(Row,F) satisfies hypotheses a) and b) 
in Theorem 13. 151 Our choice of the axiom AXIOM p will make this step readily obtainable. 

3 

The universal defining axiom for F is obtained from a modified version of Cobham's 
recursion theoretic characterization of the polytime functions. Here we use the fact that 
each polytime function can be obtained from AC functions by composition and at most 
one application of the bounded recursion operation. In each complexity class of interest 
it turns out that a suitable function F complete for the class can be defined by such a 
recursion of the form 

F(0,X) = (Init(X)) <t( P>W) 

F{x + 1, X) = (Next(x, X, F(x, X)))<*( X+1 >W) 

where Init(X) and Next(x, X, Y) are AC functions, t(x, y) is a polynomial, and X <y is 
the initial segment of X of length y. 

We will first define the universal theory T in the same manner that we have defined 
VTC . Here we will not introduce the new functions Init, Next and X <y but will use their 
Xlg 3 definitions instead. In other words, F can be defined as follows: 

F{0,X)(z) ~z<t(0,\X\) Aip InU (z,X) (3.28) 
F(x + 1, X)(z) <-» z < t(x + 1, \X\) A y Next {z, x, X, F(x, X)) (3.29) 

where <fii n it and tfNext are the Sq 3 bit definitions of Init and Next respectively. (Note that 

in V , if init and tfNext are equivalent to open formulas of C FAC o.) 

The language Cpc of functions in FC is defined in the same way as C FTC o (Defini- 
tion I3.10)) . except for numones is replaced by F. The theory T is defined similarly to 
VTC° (Definition EIEl), with the defining axioms ([3.28)1 and 1)3.29)1 of F replacing the 
defining axioms of numones. The following Corollary follows from Theorem 13 .201 

^Note the fact that Si theorems of T can be witnessed by functions of FC follows easily from Herbrand's 
Theorem. The General Witnessing Theorem offers more than we need here. It is necessary in Section 0] 
where we show that VTC is RSUV isomorphic to A^-CR. 
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Corollary 3.23. For each theorem 3Z(p(a, a, Z) of T , where if is a g£± formula, there 
are functions F of Cfc such that 

T h VzVX <p(x, X, F(x, X)). 

On the other hand, T proves the S^(£ FC )-COMP scheme, and thus can Ylf (£fc)- 
define all functions of Cfc ■ 

Now we will define T. Our choice for the defining axiom of F comes from the above 
definition of F given in (|3.28[) . (|3.29|) . In order to prove Claim l3~2"o1 fsee the discussion below) 
we will not compute F for a single value of X, but rather multiple (i.e., polynomially many) 
values of X. Let ipp (a, b, X, Y) be the formula stating that Y encodes simultaneously the 
o recursive computations of F(a,X^), . . . , F(a, X^) using the definition of F. More 
precisely, let cpp (a, b, X, Y ) be 

Vy < 6, [W < aYM(z) <- <p InU (z,XW) A 

(3 30) 

Vx<aVz<a, Y^ y ' x+1 \z) z < t(x + 1, \X^ |) A <p Next (z, x, X^\ Y^)] 

Definition 3.24. Let AXIOMp be VaVWXBY < (b,t(a,\X\))(p F (a,b,X,Y). The theory 
T is V° extended by the axiom AXIOMp. 

Since V° is finitely axiomatizable, so is T. 

Lemma 3.25. T is a conservative extension of T and satisfies the hypotheses a), b) of 
Theorem UTTR 

Proof. The proof is the same as the first part of the proof of Corollary 13.181 First, let 
T(Row,F) be T together with the functions Row and F and their defining axioms ()3.2j) . 
(|3.28|) . (|3.29|) . Note that T(Row,F) is conservative over T, because both Row and F are 
Ef -definable in T. (The Sf -definability of F follows by AXIOMp.) Assume that 

Claim 3.26. T(Row,F) satisfies hypotheses a) and b) in Theorem \S.15\ 

Then T is obtained from T(Row , F) by a series of conservative extensions satisfying 
hypotheses a) and b) of Theorem 13.151 

It remains to prove the Claim. We proceed as in the proof of Theorem 13.151 In fact, 
it suffices to show that T(Row, F) proves the existence of W such that for all z < b, 
is the intended value of F(s,T) where s,T are terms of C\{Row) which may contain z. 
(Compare to (|33T|l .l Using AXIOMp, such W can be constructed using S^-COMP. □ 

Corollary 3.27. The H\- definable (and the -definable) functions in T are precisely 
those in Cfc- 

Proof. Each function of Cfc has a 'Sq(Cfc) definition, which is equivalent in T to a Xlf 
formula, by Lemma 13.251 It is therefore definable in T . 

On the other hand, S{ theorems of T (and hence of T) are witnessed by FC functions, 
as shown in Corollary 13.231 □ 

Note that the axiom NUMONES is a special case of AXIOMp. It is "nicer" than 
AXIOMp in the sense that it encodes only a single computation of numones. In fact, 
Claim E33 shows that VTC° (Row) proves AXIOM 

numones- We need this in order to show 
that VTC° satisfies the hypotheses a) and b) of Theorem 13.151 (Lemma fo.lfij) . However, 
the proof of this Claim is rather ad hoc. 
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In general, our choice of AXIOM f guarantees that T(Row,F) satisfies the hypotheses 
a) and b) of Theorem 13 .151 (as shown in Claim l3~.26j) . Thus to go further and obtain "nicer" 
axiom than AXIOM p (in the style of NUMONES), it remains to prove the analogue of 
Claim 13", 171 These proofs may differ for different chosen functions F. Some examples are 
given below. 

3.6.1. Theories for AC°(m) and ACC. Theories for the complexity classes AC°(m) and 
ACC are defined in the same way that VTC° is defined for the class TC°. For m > 2, 
tpMODm{X,Y) is the formula stating that Y is the "counting modulo m" array for X: 

ipMOD m (X,Y) =[Vz < \X\3\y < mY(z,y)] A Y(0,0) A Vz < \X\Vy < to, 

Y(z, y) D [(X{z) D Y(z + 1, y + 1 mod to)) A (^X(z) D Y{z + 1, y))]. 

(3.31) 

Here, we identify the natural number m with the corresponding numeral to. We take ip{y 
mod to) as an abbreviation for 

3r < m,3q < y, y = qm + r A (f(r). (3.32) 

Thus if ip(y) is 5^, then ip(y mod to) is also S^. 

Definition 3.28. For each m>2, let MOD m = \/X3Y(p M OD m (X,Y). Then 

V°(to) = V° U {MOD m } 

VACC = V° U {MOD m | to > 2}. 

Note that the string Y in MOD m can be bounded by (\X\,m). 

The following Theorem can be proved in the same way as Theorem 13.61 

Theorem 3.29. The S}- definable (and the T,f -definable) functions in V° (m), and VACC 
are precisely those in FAC° (m), and FACC, respectively. 

Corollary 3.30. //VACC is finitely axiomatizable, then ACC = AC (to), for some to. 
Proof. If VACC is finitely axiomatizable, then by compactness, it is equal to 

V° U {MODi \ 2<i< to'}, 
for some to'. Let to = lcm{2, . . . , to'}, then 

V°(to) h {MODi \ 2<i< to'}. 
Therefore VACC = V°(to), and the conclusion follows from the theorem. □ 
Corollary 3.31. //VACC h NUMONES, then TC° = AC°(m), for some to. 

3.6.2. Theories for NC fc and NC. A lan guage is in nonuniform NC 1 if it is computable by 
a polynomial-size log-depth family of Boolean circuits. Here we use uniform NC 1 , which 
means Alogtime, the class of languages computable by alternating Turing machines in 
log time. Buss BusST^ shows that the Boolean formula value problem is complete for 
Alogtime. In general, for each k G N uniform NC fc can be considered as the class of 
relations which are AC°-reducible to the circuit value problem, where the depth of the 
circuit is bounded by (log n) k . The function class FNC fc consists of functions AC°-reducible 
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to the above problem, or equivalently the functions computable by uniform polynomial-size 
(log n) fc -depth constant-fanins families of Boolean circuits. Also, 

NC = \J NC fc , FNC = \J FNC fc 

k>l k>l 

The two-sorted theory VNC 1 introduced in |Coo05| ICM05) is originated from Arai's 
single-sorted theory AID [AiaQS] • It is the theory V° extended by the axiom scheme 
- TreeRec, which essentially exhibits the evaluations of log-depth Boolean circuits given 
their specification and inputs. 

Informally, consider a log-depth Boolean circuit (i.e., a formula) whose gates can be 
numbered such that the input gates are numbered a, ... ,2a — 1, output gate numbered 1 
and other internal gates are numbered 2, . . . , a — 1. Furthermore, inputs to gate i (where 
i < a) are from gates numbered 2i and 2i + 1. Let the gate i be given by a formula 
4>(i)\p,q] which might have other parameters, i.e., the intended meaning of <fr(i)[p,q] is the 
output of the gate numbered i when its two inputs are p, q. The Yq- TreeRec for 4> explicitly 
evaluates all the gates of such circuit when it is given inputs Z(0), . . . Z(a): for i < a, Z(i) 
is the value output by gate numbered i. Formally, it is defined as follows: 

3Z < 2a\fi < a[Z{i + a) «-► ip(i) A < i D {Z{i) <-> <f>(i)[Z(2i), Z(2i + 1)]] 

It has been shown Coo05 , CM05 that the S}-definable functions in VNC 1 are precisely 
the functions in FNC 1 , the function class associated with NC 1 . 

It is easy to show that VNC 1 can be axiomatized by V° and the following single 
instance of the S^- TreeRec axioms. This instance is obtained by replacing cj)(i) [Z(2i), Z{2i+ 
1)] by the formula S 'elect (W (i), Z(2i), Z(2i + 1)), where Select(p,q,r) stands for 

(pA(gAr))V(^pA(gVr)) (3.33) 

Loosely speaking, we think of W as specifying the circuit: If W(i) holds then the i-th gate 
is a A-gate, otherwise it is a V-gate. 

We will now define the theories characterizing NC fc (note that for k = 1 we obtain 
the same theory as VNC 1 , but we will not prove this fact here). For each k, the complete 
problem for NC fc is given by a circuit of depth 0((logn) fc ) and its inputs. (The function 
logn is definable in IAo, e.g., see |Pet93j .) Consider a circuit of depth (loga) fc , where each 
layer contains at most (a + 1) gates. The layers are indexed according to their depths: 
(input gates), . . ., (loga) fc (output gates), with the outputs of gates on layer d connect to 
the inputs of gates on layer d + 1. On each layer, the gates are numbered 0, . . . , a (i.e., any 
gate is indexed by its layer and its position on the layer). 

Such circuit can be described by listing the gates together with their layers index and 
their inputs gates positions (on the layer below it). Thus we have a string variable Y which 
specifies the wires of the circuit: for d < \og k a and x,y,z < a, Y^(x,y, z) holds if and 
only if inputs to gate z on layer d + 1 are from gates x, y on layer d. We also have a string 
variable W that specifies the type of each gate, i.e., if VF^z) holds then the z-th gate 
on layer d is an A-gate, otherwise it is an V-gate. The formula v? NC fc (a, X, Y, W, Z) below 
states that Z evaluates all the gates of the circuit specified by Y and W when it is given 
inputs A(0), . . . , X(a). In particular, the output of gate z on layer d is Z^- d \z). The formula 
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<^ NC fc (a, X, Y, W, Z) is defined to be 

Vd < log fc aVz < a3\x, y < aY [d] (x, y, z) D 

(Vz < aZ^(z) *-> X(z)) A Vd< log* aVx, y, 2 < a, 

Y M (x,?/,z) D «-► Select{W ld+1] {z),Z^(x),Z^(y))) 

where Select is denned in (|3.33|) . 

Definition 3.32. Let A NC k denote 3Zip NC k (a, X, Y, W, Z). The theory VNC fc is V° ex- 
tended by the axiom 4 NC ii . The theory VNC is 

\J VNC fc 

fc>l 

Again, note that in ^4 NC fc , Z can be bounded, therefore VNC fe is equivalent to a theory 
with bounded axioms. Proving the first sentence in Theorem 13.331 below is somewhat easier 
than Claim 13". 171 

Theorem 3.33. For each k > 1, 

VNC 1 ' h VXVY VWBZVw < bip NC k (a, X^ ,Y^ W \ , #H ) . 

^4 function is in FNC fc iff it is Y,\-definable in VNC*. A function is in FNC iff it is 
T^-definable in VNC. 

3.6.3. Theories for NL, SL ; L and P. NL is the class of problems solvable in a nonde- 
terministic Turing machine in space O(logn). We consider NL as the class of two-sorted 
relations AC°-reducible to the Graph Accessibility Problem GAP (also known as Path, or 
Reachability problem). This is the problem of deciding whether there is a path from s to t 
in a given (directed) graph G, where s, t are the 2 designated vertices of G. 

We can obtain a theory that characterizes NL by formalizing the following polytime 
algorithm that solves GAP. For each distance k = 0, 1, . . . , n — 1 (where n is the number of 
vertices in the graph), simply list all vertices that can be reached from s by paths of length 
at most k. This enables us to check if t is reachable from s by paths of length at most n, 
i.e., if there is a path from s to t in G. 

Using GAP, the theory VNL is developed in the same style of VTC°. The axiom 
that formalizes the algorithm solving this problem is called LC (for Logspace Computation). 
In the following definition, E codes a directed graph, and Z is intended to code the above 
polytime algorithm. Here we identify the source s with 0. Let ipic be the following formula 

<PLc(a, E, Z) = Z(0, 0) A Vi < a^Z(0, i)A 

Vk,i<a, Z(k + l,t) <-»■ [Z(k,i) V3j < a, E(j, i) A Z(k, j)]. { ' > " >l ' 

Note that in (j3,34|) . Z(k, i) holds iff there is a path from to i of length at most k. 

Definition 3.34 (VNL). Let LC denote VcN E3Z < (1 + (a, a))<p LC (a, E, Z), Then VNL 
is the theory V° extended by the axiom LC . 

It can be shown directly that the class of -definable functions in VNL is precisely 
FNL, the class of functions whose bit graphs are in NL. Here we can show this using 
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Corollary 13.271 It amounts to showing that VNL proves the axiom AXIOM f gap (where 
Fgap(cl, E) is essentially the function whose graph is (pLc(e,E,Z)), i.e., 

VNL h VaVW-EBZ < (b,a,a)\fy < bip FoAP {a,E^\Z^). 

This is analogous to Claim l3~. 171 The proof idea is similar; details are omitted. 

In the same spirit, a series of theories for L (class of problems solvable by a Turing 
machine in space O(logn)), SL (class of problems solvable by a symmetric nondeterministic 
Turing machine in space O(logn)), and P can be obtained using similar complete problems. 
For L the complete problem is GAP restricted to directed graphs whose vertices have out 
degree at most 1; for SL the complete problem is GAP restricted to undirected graphs; and 
for P the complete problem is the circuit value problem. 

Remark It is not a surprise that the theories obtained this way are "minimal", and thus 
coincide with a number of existing "minimal" theories that characterize the corresponding 
classes. In fact, it can be shown that in case of L, the theory obtained is actually Zambella's 
theory Xl^-Rec Zam97 j , and in case of P, the theory obtained is the same as TV poo05 
(and thus the same as V^HORN CK03 ). Thus, these results explicitly exhibit the finite 
axiomatizability of S^-Rec and TV . In the case of NL, it has been shown |Kol04| that 
VNL is the same as V^KROM (see also |CK04j ). In the next section we will show that 
VTC° is RSUV isomorphic to Johannsen and Pollett's "minimal" theory A^-CR. 

4. RSUV Isomorphism Between VTC° And A^-CR 

4.1. The Theory A^-CR. The theory A^-CR [.TPOOj is a single-sorted theory whose 
definable functions are precisely the (single-sorted) TC° functions. It is claimed to be a 
"minimal" theory for TC°. We will show that it is RSUV isomorphic to our theory VTC°. 
First, we recall the definition of A^-CR. 
The underlying vocabulary of A^-CR is 

^A'-CR = [°> S > +! •> H x \ ' W> X #V> - ' MSP 'i -] 

(here S is the successor function, and MSP stands for most significant bits, MSP(x, i) = 
\x/2 l \). The theory A^-CR is axiomatized by the defining axioms for symbols of £ A b_ CR , 

the axiom scheme Open-LIND , and the A J bit-comprehension rule (below). 

The defining axioms of the symbols of jC^-cr are straightforward. The axiom scheme 
Open-LIND can be seen as a scheme of induction on "small" numbers (i.e., \z\) for 
quantifier-free formulas. Formally, Open-LIND is the set of 

[99(0) A Vx, <p(x) D <p(Sx)) D Vz(p(\z\), (4.1) 

where ip is an open formula. The A^ bit-comprehension rule is defined as follows. First, 
given a formula <p(i) (which might have other free variables), the comprehension axiom for 
ip(i), denoted by COMP^^fo), is the formula 

3x < 2 |a| Vf < \a\ [BIT(i,x) «-► <p(i)\. 

Here BIT(i,x) holds if and only if the ith bit in the binary representation of x is 1 (the 
bits of x are counted from for the lowest order bit). It is defined by 

BIT(i,x) = mod2(MSP(x,i)), where mod2{x) = x- 2 • [^J- 
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Then, the A* bit-comprehension rule is the following inference rule: 

<p(i) <-> 
COMP, (l) (t) 

where tp is a S \ formula, ip is a IIj formula, and i is a term. 

Note that formally, A^-CR is defined inductively using the above rule. More precisely, 
A^-CR is the smallest theory that contains the axioms described above, and is closed under 
the A^ bit-comprehension rule, i.e., if tp(i) <-> ip(i) is in A^-CR for some S^ formula ip and 
IT] 1 formula ip, then COMP^^i) is also in A^-CR, for any term t. Let A^-CRj be the 
sub-theory of A^-CR where proving each theorem of A^-CR,, requires at most i nested 
applications of the A.\ bit-comprehension rule. Then 

A^-CR= \J A^-CR. 

An open question jJPOOj is whether A^-CR = A^-CR,, for some constant i. Since VTC° 
is finitely axiomatizable, the RSUV isomorphism between A^-CR and VTC proved below 
shows that A^-CR is also finitely axiomatizable. It follows that A^-CR = A^-CRj for 
some constant i. 

Note that there is no side formula in the A^ bit comprehension rule, and thus it is 
apparently weaker than the A.\ bit-comprehension axiom scheme: 

Vi(p(i) <- m) 3 COMP„ (i) (t) (4.2) 

where ip is a S^ formula and ip is a Tl\ formula. In fact, CT04 shows that A^-CR does not 
prove the above comprehension axiom scheme unless RSA can be cracked using probabilistic 
polynomial time algorithms. 

Remark: We can obtain a single-sorted theory which is equivalent to A^-CR as 
follows. Let T be the theory over the vocabulary £ A b_ CR U {BIT} which is axiomatized 

by the defining axioms for symbols in jCa^-cr ^ {BIT} together with Sq-COMP, i.e., 
COMPpw(a) for Sq formulas <p(i). Then the arguments given in Subections 4.2, 4.3 
below also show that T is RSUV isomorphic to VTC . It follows that T is a conservative 
extension of A^-CR. (A direct proof of this can be obtained by (i) noticing that BIT is 
definable in A^-CR, and that A^-CR proves Sq-COMP using the A^ bit-comprehension 
rule; and (ii) showing that the A^ bit-comprehension rule is provable in T using the same 
arguments as in Subsection 4.4 below, and that Open-LIND is provable in T using 
Sq-COMP and the axioms for \x\ and BIT.) 

4.2. RSUV Isomorphism. We will prove that A^-CR is RSUV isomorphic Jan90a ( 
Raz93, Tak93] to our theory VTC . A major part of this proof is in defining multipli- 
cation for second sort objects and proving the commutative and distributive laws. Here we 
identify each bounded subset X with the number 

A(0)2° + ...A(n-l)2 n - 1 , 

where n = \X\. Then the multiplication function X-Y is defined as the product of these "big 
numbers" corresponding to X and Y. Note that it is quite straightforward to formalize the 
conventional (polynomial time) algorithm for multiplication in theories that characterize 
P, such as V 1 |(Joo| . However this is less straightforward in the case of VTC . Indeed, 
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the conventional algorithm might not be in TC . Note that the multiplication function 
is already complete for TC°. Here we define this function in VTC° using the fact that 
computing Y from X in (or equivalently the function numones) is also complete for 
TC°. In particular, we define multiplication in VTC° by formalizing a reduction from 
numones. We use the same method as in BPROO , where it is shown that the properties of 
multiplication have small TC°-Frege proofs. 

Note that reasoning in VTC is more uniform than in TC°-Prege. For example, in 
VTC the "input bits" are already ordered (i.e., the bits in the string X(n — 1) . . . X(0) 
are numbered), while this is not the case in TC°-Frege. Consequently, the definition of 
the sum of n strings in TC°-Frege does not depend on the order of the strings (i.e., it is 
symmetric in terms of the arguments). In VTC proving this independence is a nontrivial 
task. It is true, although nontrivial, that each 5]^(£ FTC o) theorem of VTC translates into 
a family of propositional tautologies having polynomial-size TC°-Frege proofs. It follows 
that the proof system bounded depth TC°-Frege can define string multiplication and prove 
its properties using polynomial size proofs. These bounded depth TC°-Frege proofs can 
be seen as the uniform versions of the TC°-Frege proofs in jBPKOOj . 

4.2.1. Outline of the RSUV Isomorphism. We establish the RSUV isomorphism between 
A^-CR and VTC by (a) constructing from each model A4 of A^-CR a model Af of 
VTC whose second sort universe is the universe M of Ai, and whose first sort universe is 
the subset log(M) = {\u\ | u G M}; and (b) constructing from each model Af of VTC a 
model Ai of A^-CR whose universe is the second sort universe of Af. These constructions 
have the property that if we follow (a) to get a model Af of VTC from the model A4 of 
A^-CR, and then follow (b) to get a model M' of A^-CR from Af, then M! and M are 
isomorphic. Similarly, if we start with a model TV of VTC and follow (b) to get a model 
M of A^-CR, then follow (a) to get Af' fr om A4, then Af and Af' are isomorphic. 

Corresponding to (a) there is a syntactic translation sending a sentence <p in the lan- 
guage of VTC to an equivalent sentence tp^ in the language of A^-CR and corresponding 
to (b) there is a syntactic translation sending a sentence ip of A^-CR to an equivalent 
sentence ip* in the language of VTC . (The b and ft notation is from jEaz93j .) Recall from 
Corollary 13. 181 that VTC is a conservative extension of VTC . These translations can be 
pictured as follows: 



A^-CR ~ 


VTC 


M ->> 


Af 


^ b ^ 




M' <- 


Af' 







The construction in (a) is straightforward. Let A4 be a model of A^-CR with universe M, 
we construct a model Af of VTC as follows. To get the second sort universe of Af, we 
simply identify each number a G M with the subset X (bounded by |o|) of those i such that 
the ith bit in the binary representation of a is 1. The symbols of VTC are interpreted 
accordingly, i.e, 0, 1,+, -,=i and < are interpreted as in A4 (restricted to log(M)), and 

\X\ = \a\, and i G X <^ BIT(i,a) = 1 if X = {% \ BIT(i, a) = 1}, 
X =2 Y if they are mapped from the same number a G M. 
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It remains to show that the axioms of VTC hold in TV. We use the fact that each 
formula (p of VTC translates to the formula <^ which is provably equivalent in A^- CR 
to a Xlg formula. Since AA is a model of A^-CR, it is easy to check that the axioms in 
2-BASIC are satisfied in Af. The axiom scheme S^-COMP are satisfied in Af since AA 
satisfies the Aj bit-comprehension rule. Now we show that NUMONES holds in Af. Let 
a € M, and a n _i . . . ao be the binary representation of a. We need to get the "counting 
array" for the set 

X = {% | BIT(i,a) = 1}. 
Let a' S M whose binary representation is a n _iO . . . 0a n _20 . . . Ooq, where every block of 
O's has length (1 + |n|). Let b £ M with the binary representation 10 . . . 010 ... 01 (n l's, 
and each block of O's has length 1 + |n|). Note that a' and b exist in M by the A.\ bit- 
comprehension rule. It is straightforward that the counting array for X can be extracted 
from the product a' ■ b. 

The construction in (b) is done by reversing the above construction. Suppose that Af 
is a model of VTC . We can view Af as a model of VTC , where the symbols of £ FTC o 
are interpreted according to their defining axioms given in Definition 13.101 We construct a 
model A4 for A^-CR by interpreting each second sort object X of Af as the number 

A(0)2° + ... + X(n-l)2 n -\ (4.3) 

(i.e., the number whose binary representation is X(n — 1) . . . X(0)) where n = \X\. All 
symbols of >C A t_ CR except for • are interpreted in a straightforward manner. For example, 
if a is the number in A4 with the value from (|4,3|h for some second sort object X £ Af, 
then \a\ = \X\ (more precisely, there is a second sort object Z € Af such that in Af, 
\X\ = Z(0)2° + . . . + Z(m - l)2 m -\ where m=\Z\, and | a\ is the number associated with 
Z). The axioms of A^-CR describing these symbols hold in A4 because their translations 

(except those involving •) are easy theorems of VTC . (We will present a proof of the 
associativity of string addition in Appendix 0) It remains to (i) interpret •, and prove its 
properties in AA, and (ii) show that other axioms of A^-CR are satisfied in Ad. For (ii), 
the axiom scheme Open-LIND holds in AA, since Open-IND holds in VTC°. Therefore 
we will present only the proof that the A J bit-comprehension rule is satisfied in AA. 

4.3. Interpreting Multiplication for the Second Sort Objects in VTC°. Now we 

need to define the "string multiplication" function X-^Y (we will simply write X-Y), which 
is the binary representation of the product of the two numbers corresponding to X and Y 
by the mapping Q4.3JI . It is known that the complexity of computing X ■ Y is AC complete 
for TC° CSV84 . Thus our task is to formalize in VTC a TC° algorithm computing this 
product. This can be reduced to computing the sum of n strings. The "school algorithm" 
is to write down the strings and sum up the bits in the same columns, starting from the 
lowest order bits, with carries from the previous columns. However, it might not be possible 
to formalize this algorithm in VTC , and we will formalize the algorithm from BPR00 , 
where it is shown that multiplication can be defined in TC°-Frege. 

4.3.1. Adding n Strings. Suppose that we are to add n strings, each of length < m (written 
as a table of n rows and m columns). The methods from |BPE,00j is to divide the m columns 
into 2k blocks, each consisting of £ columns. (Thus each block has n substrings of length 
£.) The numbers k and I are chosen so that the sums of the substrings in the 2k blocks can 
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be computed concurrently. It remains to use these sub-sums to obtain the desired sum; a 
further requirement for k and £ is that this last step can be carried out efficiently. 

More precisely let £ = 1 + flogn] and k = \m/2£~\. Notice that the sum of the n 
substrings in each block is a string of length bounded by 2£, or equivalently a number (i.e., 
first sort object of J\f) which is < 2 2 ^ < An 2 . Let bo, ... , &2fc-i be the sub-sums. The sum 
of the original n strings is computed from 2k such "short" strings by first "concatenating" 

60, 62, ... , b2k-2 and "concatenating" 61, 63, . . . , 62^-1 (i- e -> concatenating the binary string 
representations of bo, b<i, ■ ■ ■ , &2fc-2> an d concatenating the binary string representations of 

61, 63, ... , 62*1-1), then adding the 2 resulting strings together. 

Formally, suppose that the n strings are represented as n rows . . . , Z^- n ~^ in an 
array Z (using the pairing function). Our goal is to compute their sum Sum{n,m, Z) as a 
string function of n, m, Z. 4 Note that if for each i, < i < m, Ci is the total number of bits 
in the ith column of Z, then 

m— 1 

Sum(n,m, Z) = 2*Cj. 

i=0 

We will "store" q's in a string W, and then define Sum(n,m, Z) as a function 
Sum'(m,n,W). 5 Here W is a TC° string function of n, m and Z: it has m rows, and 
the row of W has length exactly q. It can be defined as follows. First, let Z be the 
transpose of Z: for < i < m, 

\Z^ \ < n A Vj < n Z [i] (j) <-> Z(j,i). 

Then the total number of bits in the ith column of Z is exactly numones (n,zW), the total 
number of bits in the ith row of Z. Now W = AddCols(n, m, Z) where AddCols{n, m, Z) is 
defined by 

\AddCols(n, m, Z)\ < (m,n)A\fi <m,j < n AddCols(n,m, Z)(i, j) <-» j < numones (n, Z^). 

(4.4) 

We need to compute 

m— 1 

Sum'{m,n,W) = 2 < |W M |, (4.5) 
i=o 

where n is a bound for \W^\, \W^ m -\ \W^ \ < n for < 1 < m. 

Notice that the number functions 2 X where x < \a\ for some number a G M, and logic, 
are m FTC (in fact, they are m 

FAC° Bus98bHCnHI)- Let I and k be as in the above 

discussion, i.e., 

£ = 1+ flogn], k=\m/2£]. 
Write a for \W®\, for < i < m. Divide c m _i, . . . ,Co into 2k blocks of length £ each: 
C2fc£-1; • • • > c (2k-l)f) c 2 £_i,...,q; Q_i,...,Co- 

For < i < 2k, we will define bi to be the sum of the ith block, bi = Y2j=o ^ c it+j- Formally, 
this is a number function of W, i and £, i.e., 6j = sum(W,i£,£) where 

e-i 

sum(W, a, £) = 2 j c a+ j 
j=o 

^Here n, m indicate the "size" of Z, i.e., it has n rows, each of length < m. 
''Note the difference in ordering of n and m as arguments in Sum and Sum' . 
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(the sum of the block of length £, starting from a). Here, sum can be defined using numones: 
sum(W, a,£) is the number of bits in the "long" string Y, 

sum(W,a,£) = numones (\Y\,Y), 

where Y consists of 1 substring of c a l's; 2 1 substrings, each of c a+ i l's; . . .; 2 l ~ l substrings, 
each of c a+ ^_i l's. Obviously, we can define such Y as an AC function of W: 

\Y\ < 2 e n A Vj < £Vu < 2 j Vv < n [Y((2 j - l)n + un + v) v < c a+j ], 



(note that n is a bound for c a , ■ ■ ■ ,c a +e-i)- Also, VTC proves the following properties of 
sum: 

sum(W,a,0) = c a , sum(W,a,£ + 1) = sum(W,a,£) + 2 e c a+ £, sum(W,a,£)<n2 e . 

In particular, we have b{ < 2 2e , for i < 2k. 
Let 

L = "£2™b 2u # = x> 2 *+n 2m . 

i=0 i=0 

Since b{ < 2 2e for i < 2k, L and H can be computed simply by concatenating the binary 
representations of bo, 62, . . . , &2fc-2 and b\, 63, . . . , &2fe-l> respectively. (More precisely, we 
may have to pad each bi with leading 0's to make them of length exactly 2£, and then 
concatenate these strings of equal length.) 
Now 

2fc-l 

Sum'(m, n,W)= ^ 2 il bt = L + H. 

i=0 

As a result, Sum(n,m, Z) = Sum'(m,n,W) is a function of £ FTC o. Thus we can define 
X ■ Y as follows. 

Given X and Y, let X <g> Y be the "table" that we use in the "school algorithm" to 
multiply X and Y , X ®Y = Z where 

\Z\ < {\X\ + \Y\)\Y\ A V.x < \X\Vy < \Y\, Z(y, x + y) <-> [X(x) A Y(y)}. (4.6) 

(Z has \Y\ rows, each is of length < \X\ + \Y\.) Then X Y = Sum(\Y\, \X\ + \Y\,Z). It 
follows that X ■ Y is a function of £ FTC o . It remains to prove the properties of this function, 
i.e., it is commutative, and distributive over X + Y. 

4.3.2. Proving Properties Of X Y . First we need to show that -2 is commutative. 



Lemma 4.1. VTC h X ■ Y = Y ■ X. 

Proof. Recall that we define Sum(n, m, Z) = Sum' (m, n, W), where W = AddCols(n, m, Z) 
which is defined in (|4.4jl . Thus it suffices to show that 

AddCola(\Y\,m,X ®Y) = AddCols(\X\,m,Y <g> X), (4.7) 

where m = \X\ + \Y\. 

- M 

Let Z\ = X <S> Y and Z2 = Y ® X. Notice that for i < m the column Z[ of Z\ and 
column Z$ °f ^2 are just permutation of each other. In particular, \zf^\, \Z$\ < i + 1, and 

^f ] (y) ^ y < * a a - y)i ^ x < f a a(x) a y{% - x), 
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and hence zf\y) <-> Z$(i — y), for y < i. To prove (|4.7|) . we will show that for i < m, Z^ 
and Z% have the same number of elements, i.e., 

numones(i, Z^) = numones(i, zjy). 

It suffices to prove more generally that if there is an one-one mapping between Z\ [i] and 
Z2[i], then they have the same number of elements. This is proved in the next lemma. □ 

In the following lemma, suppose that there is an one-one mapping (specified by M) 
between the initial segments {i j i € X A i < £} and {j j j £ Y A j < £} of X and Y 
respectively. Then these initial segments have the same number of elements. 

Lemma 4.2. Let £, X, Y, M be such that 

Vi < £3\j < £M(i,j) A Vj < £3\i < £M(i,j), and \fi < £, X(i) «-» 3j < £(M(i, j) AY(j)). 

(4-8) 

Then, VTC° h numones(£, X) = numones(£,Y). 

Proof. First, from 1)4. 8 jl it is easy to see that 

Vj < £, Y(j) ~3t< £(X(i) A M(i,j)). 

Let Z be the string such that Z^ is the image of the initial segment {i \ i G X A i < k} of 
X, i.e., 

Vk < Nj < £ [ZW(j) ^3i< k(M(i,j) A X ({))]. 

Then, Z$ = Y. We can prove by induction on k that numones(k, X) = numones(£, Z^). 
Consequently, numones(£, X) = numones(£,Y). □ 

Now we will show that -2 is distributive over +2. 

Lemma 4.3. VTC° h X • (Y + Z) = X ■ Y + X ■ Z. 

Proof. It suffices to prove 

X <1 • (Y + Z) = X <{ ■ Y + X <i ■ Z (4.9) 
by induction on i, where X <1 is the i low-order bits of X; that is 

X< 1 = {j<i\ X(j)}. 

The base case follows from the fact that • Y = 0, which can be proved from the definition 
of X ■ Y. 

For the induction step there are two cases: X <1+1 = X <% and X t+1 = X <% + {i}. Since 
the first case is trivial, we consider the second case. To simplify notation, we will write X 
for X <{ and write X' for X + {i} = X <i+1 . 

Thus our task is to prove in VTC° 

X' ■ (Y + Z) = X' • Y + X' ■ Z (4.10) 

from the induction hypothesis 

\X\<% A X ■ (Y + Z) = X ■ Y + X ■ Z. 
We need the following fact, which we prove below: 

VTC° h \X\ < i D (X + {i}) • Y = X • Y + {i} ■ Y. (4.11) 
From the definition of X ■ Y we have 

X-{i} = {x + i\xeX} (4.12) 



32 



PHUONG NGUYEN AND STEPHEN COOK 



From the commutativity of -2 (Lemma l4.1|) . the associativity of +2 (Lemma lA.2|) . and (|4.12j) 
we can derive that 

{i} ■ (Y + Z) = (Y + Z) ■ {i} = Y ■ {i} + Z ■ {i} = {i} ■ Y + {i} ■ Z. (4.13) 
Now we prove (|4.10j) as follows, using associativity and commutativity of +2- 
X'-(Y + Z) = X-(Y + Z) + {i}-(Y + Z) [bygTQ)] 

= X ■ Y + X ■ Z + {i} ■ (Y + Z) [by Ind Hyp] 
= X ■ Y + X ■ Z + {i} ■ Y + {i} ■ Z [by dUSD ] 
= X'-Y + X'-Z [by gUJ]. 
It remains to prove ()4.11|) . Using the commutativity of -2, rewrite the equality in (|4.11|) 

as 

Y ■ (X + {i}) =Y -X + Y ■ {i}. 

To prove this, it suffices to prove that 

Sum(i, i + \Y\,Y®(X + {i})) = Sum(\X\, \X\ + \Y\, Y ® X) + Y ■ {i}. 

Notice that since |X| < i, the "table" Z\ = Y <g> (X + {i}) is exactly Y ® X appended with 
an additional row 

zf ={y + i \yeY} = Y- {i}. 
Therefore l)4.11jl follows from the next lemma. □ 

Lemma 4.4. Suppose that \Z$ I < m, for < i < n. Then VTCT h Sum(n + 1, m, Z) = 
Sum(n, m, Z) + Z^ . 

Proof. We have defined Sum using Sum' . (Recall the definition of Sum' in (|4.5jl .) We need 
to show that 

Sum'(m, n + 1, W) = Sum'(m, n, W\) + Z^ 

where 

W x = AddCols{n,m,Z), W = AddCols(n + l,m, Z), 
It is straightforward that for i < m, 

We will prove by induction on m' < m that 

Sum'(m',n+l,W) = Sum'(m', n, W x ) + (Z [n] ) <m ' , (4.15) 

where X <z is the initial segment {x \ x € X A x < z} of X. 
For the base case, (|4.15|) obviously holds when m' = 0. 

For the induction step, suppose that (|4.15|) holds for some m' < m. Note that by the 
definition of Sum' (|4.5|) . intuitively, 

Sum'(m' + l,n + 1, W) = Sum'(m', n + 1, W) + 2 m ' \W^ \. 

Formally, let ToString(c,£) be the set 

ToString(c,£) = {i + £ \ BIT(i,c)}. 

Then we can show from the definition of Sum' that 

Sum'(m! + 1, n + 1, W) = Sum'{m , n + 1, W) + To 'String (c m / , to'), 
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(where c m i stands for |jy[ m l|). Similarly, 

Sum'im' + l,n,Wi) = Sum 1 \m! ,n,W\) + To String (c^/ ,m'), 

where c 1 , stands for Iwj 771 ^. 

By the induction hypothesis, it remains to show that 

ToStmng(c m/ ,m') + (ZM)<™' = To String^ ,m') + (Z^) <m ' +1 . 

This follows from (|4.14l) and the definition of ToString. □ 

4.4. Interpreting the A\ Comprehension Rule in VTC°. Recall the definition of 
the A^ bit-comprehension rule (in single-sorted logic) in section 14.11 Note that this rule 
specifies an inductive definition of A^-CR. In order to show that M is a model of A^-CR, 
where M is the structure constructed from a model M of VTC° as discussed in (b) of 
section 14.2.11 we will show that VTC° (and VTC ) satisfies the gA;f comprehension rule, 
the two-sorted version of the A.\ bit-comprehension rule. This rule for two-sorted theories 
is obtained from the A* bit-comprehension rule using the syntactic translation ip ip* 
described in section 14.2.11 

Recall the definition of gSf and gllf formulas given in section 12.11 Note that under 
the translation ip — tp% and Tl\ formulas translate to formulas equivalent to those in 
gSf and gllf , respectively. 

The gAf comprehension rule is defined as follows. 

Definition 4.5. A (two-sorted) theory T over C is said to admit the gAf (£) comprehen- 
sion rule if whenever 

T hVz < b, tp(z) <-> ip(z), then T h 3X < 6Vz < b, X(z) <-> p(z) 

where tp is a gXlf (£) formula, and if) is a gllf(C) formula (ip and ip may have other free 
variables) . 

We omit C from gA;f (£) when it is clear from context. 

This rule is apparently weaker than the gA;f comprehension axiom. In particular, 
VTC may not prove the axiom. 

Our task for this section to prove the following theorem. 

Theorem 4.6. VTC and VTC° admit the gA;f comprehension rule. 

Note that it suffices to prove the theorem for VTC°, since this theory is conservative 
over VTC . We will use the g^f replacement rule, defined as follows. 

Definition 4.7. A (two-sorted) theory T over C is said to admit the gSf (£) replacement 
rule if whenever 

ThVz <b3Z <b(p(z,Z), then T h 3W < (b, b)Mz < b tp(z, W^), 
for any gXlf (£) formula tp which may contain other free variables. 

Note that if T admits the g^f replacement rule, then each gSf theorem of T is 
provably equivalent in T to a formula. 

Lemma 4.8. If the theory T (extending V (Row) ) proves S^(£)-COMP and admits the 
g£f (£) replacement rule, then it also admits the gAf (C) comprehension rule. 
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Proof. Suppose that 

T h \fz < b, <p(z) <-> tp{z), 

where ip is a gSf (£) formula, and ip is a gll^^C) formula which may have other free 
variables. Then 

T h Vz < b, <p(z) V -i^(zr). 

Therefore 

T h Vz < b3Z < 1, [Z(0) A <p(z)] V [->Z(0) A ->^(z)]. 
Now 0(z, Z) = [Z(0) A cp(z)] V hZ(0) A ->ip(z)] is equivalent to a gSf formula. Since T 
admits the gSf(C) replacement rule, 

Th3W < (b, b)\fz < b 9(z, W [z] ). 
Let X be defined by £^(£)-COMP: 

\X\ < b AVz < 6, X(z) W [z] (0). 
Then obviously Vz < b, X(z) <-> <p(z). □ 
Now Theorem 14.61 follows from the following lemma. 

Lemma 4.9. VTC° admits the gSf (£ FTC o) replacement rule. 
Proof. Suppose that 

VTC° h Vz < < b<p(z, Z), 
for some g£f(£ FTC o) formula (p(z,Z). By the g5]^ Witnessing Theorem ( Theorem I3.'20p 
there is a function F(z) of £ FTC o such that 

VTcV Vz < bip{z,F(z)). 

Let G be defined as follows: 

\G\ < (b, b) A Vz < = F(z). 

Then we have 

Vz < 6^(z,GW). 

Also, G is a function of £ FTC o. Therefore VTC° h 3W < (6, b)\/z < btp(z, W^). □ 

5. Conclusion 

We show (Theorem I2.6JI that the TC° relations are precisely those represented by 
5]q ' formulas. We also present the finitely axiomatizable, second-order theory VTC 
which characterizes TC° in the same way that Buss's theory S.j, characterizes polynomial 
time. Our characterization of TC° by the theory VTC is based on the fact that counting 
the number of 1 bits in a string is complete for TC° rather than the "hidden power" of 
the multiplication function (which is also complete for TC°) usually present a priori in 
first-order theories. 

We show that a number of combinatorial problems are provable in VTC . In particu- 
lar, we show that VTC is RSUV isomorphic to Johannsen and Pollett's "minimal" theory 
A^-CR. The main part of proving this RSUV isomorphism is in defining (string) multi- 
plication and proving its properties. The RSUV isomorphism between VTC and A^-CR 
shows that A^-CR = A^-CR; for some constant i, answering a question in jJPOOj . 
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In addition, we show that a form of the Pigeonhole Principle is provable in VTC . 
In |Bus03| Buss shows that the STCONN tautologies (and thus the HEX tautologies) have 
polynomial size constant depth TC°-Frege proofs. It can be seen that his arguments can be 
formalized in our theory VTC . The proofs of these principles in VTC are more uniform 
that the TC°-Frege proofs. 

In |Hes01j . it is shown that division is in uniform TC°. Thus the (string) division 
function might be X;f -definable in VTC . An interesting problem is to formalize the 
algorithm of jHesOlj in VTC . 6 

We are also able to generalize the method used in developing VTC to obtain a scheme 
of theories characterizing a number of other subclasses of P. Our work follows the program 
outlined in |Coo| ICoof)5| , which proposes defining and studying second-order theories and 
propositional proof systems associated with various complexity subclasses of P. We have 
not treated the connection with propositional proof systems here, but this is the subject of 
ongoing investigation. By translating proofs in our theories to the quantified propositional 
proof system G Jan90b, Mor05]. our theories should correspond to fragments of G which lie 
between bounded depth Frege and G*. In this line, the fragment for NC 1 which is different 
from Frege is called Go in jCM05| Mor02j- A proof system associated with L can be found 
in |Per05| . Investigation into proof systems corresponding to other classes is ongoing. 

The other direction in the tight connection between first-order theories and the propo- 
sitional proof systems is the Reflection Principle: Each theory proves the soundness of the 
corresponding proof system. For example, PV proves the soundness of extended Resolution, 
and in fact extended Resolution is the strongest proof system whose soundness is provable 
in PV |Coo75j . In general, the Sq 3 consequences of the theory corresponding to a com- 
plexity class can be axiomatized by formalizing the soundness of the corresponding proof 
system. Because the bounded depth Frege systems form a proper hierarchy jKra94j . this 
seems to imply that the Sq 3 consequences of V° are not finitely axiomatizable. Similar (but 
conditional) results for VTC should also hold. 

Another interesting issue is to compare various theories that characterize the same 
class. For example, it is possible that VNC C. U{, where XJ\ Coo05 is a theory that also 
characterizes NC. 
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Appendix A. Interpreting Addition for the Second Sort Objects in V° 

We define the "string addition" function X +2Y (we will simply write X + Y, the 
meaning will be clear from the context), which is the binary representation of the sum of 
the two numbers corresponding to X and Y by the mapping (|4.3|) . 

We will show that the string function X + Y can be defined in any model of V°. Here 
addition is defined using the conventional algorithm, i.e., adding digits of the same order 
in X and Y together with carries from the previous result. More precisely, let ip + (i, X,Y) 
represent the carry at the bit position i when adding X and Y. Then the ith bit of the sum 
X + Y is 

(x + Y)(i) o x(i) © Y(i) © <p + (i, x, y) 

(Here © stands for exclusive or, i.e., p © q <-> (p A -iq) V (-ip A q).) 

Definition A.l. Let (p+(i,X,Y) be the J^q formula 

3j < i, X(j) A Y{j) AVf< i[j < i D X(£) © Y{1)]. (A.l) 

Then X + Y is defined as follows: 

\X + Y\< \X\ + \Y\ A Vi< \X\ + \Y\, {X + Y){i) [X(i) © Y(i) © <p+(i, X, Y)]. 

Since the above definition is symmetric for X and Y, it follows that V° h X+Y = Y+X. 
It remains to show the associativity for this function. 

Lemma A.2. V° h X + (Y + Z) = (X + Y) + Z. 

Proof. It suffices to show that for i < \X\ + \Y\ + \Z\, 

(X + (Y + Z))(i)~{{X + Y) + Z)(i). 

This is equivalent to 

X{i) © (Y + Z)(i) © <p + (i, X, Y + Z) <-> (X + Y)(i) © Z(i) © <p + (i, X + Y,Z). 
From ()A.1|) . the above is simplified to 

(p+(i, Y, Z) © ip+(i, X,Y + Z)^ (p + (i, X, Y) © ip + (i, X + Y,Z). 

Let cii, bi, Ci and di denote ip+(i, Y, Z), tp+(i, X,Y+Z), <p+(i, X, Y) and tp+(i, X + Y, Z) 
respectively. We need to show that 

Oi% © bi <— > Cj © di, 
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for i < \X\ + |K| + \Z\. We will prove a stronger result, i.e., (04, bi) is a permutation of 
(cj, di). In particular, we will show by induction on i that 

(di Abi <-> a A dj) A (a, V bj <-> Cj V dj). (A. 2) 

The base case is trivial, since 

V° I — >a A — >6 A -■Co A — i<io- 

The induction step follows from the inductive evaluation of a% bi, a and df. 

a t+1 = rr(») A Z(i)] V [(Y(i) © Z(i)) A a<], 

6i+i = [Jr(i)A(y(i)©Z(i)0Oi)]V[(A'(i)©y(i)eZ(»)©ai)A6i], 
c m = A7(j)] V[(X(z)©F(i))A Ci ], 

di+i = [Z(i)A(X(0©y(i)©Ci)]V[(X(t)er(i)®^(0©Ci)Adi]. 

It remains to verify (|A.2|) for i + 1. This can be done by using the induction hypothesis 
and the above properties, together with checking all possible values of X(i), Y(i) and Z(i). 
Details are omitted. □ 

Appendix B. Proving the Pigeonhole Principle in VTC° 

We give an example of reasoning in VTC° by formalizing and proving the Pigeonhole 
Principle (PHP) in VTC°. This principle states that for any mapping from a set of a 
numbers to a set of (a — 1) numbers, there must be 2 numbers in the domain that have the 
same image. We will formalize and prove this principle in VTC°. In the following definition, 
the mapping is represented by the set X of pairs of pre-images and images (X(y,z) holds 
if y is the image of z). 

Theorem B.l. 

VTC° h Vz < a 3y < a X(y, z) D By < a 3zi < a 3z 2 < Zx, X(y, z x ) A X(y, z 2 ). 

Proving PHP involves formalizing a number of concepts, such as set union, total number 
of bits in an array, etc. We will define these functions below, and it is straightforward that 
they are members of jCftc • 

Union: Union(b, X, Y)(z) <-► z < b A (X(z) V Y{z)). 

We interpret Z as an array of a rows, and each row has length bounded by b. 
Finite union: FiniteUnion(a, b, Z)(z) «-> z < b A By < aZ^(z). 

Total number of bits in an array: totNumones(a,b, Z) = numones(ab, Fo(a,b, Z)), 
where Fo(a, b, Z) is the function of Z which concatenates all the rows of the array Z: 

F (a, b, Z)(ax + y) <-> Z^(y), for x < a, y < b 

Lemma B.2. The following are theorems o/VTC°: 

a) numones(b, Union(b, X,Y)) < numones(b, X) + numones(b,Y). 

b) totNumones(a + 1, b, Z) = totNumones(a, b, Z) + numones(b, 

c) numones(b, FiniteUnion(a,b, Z)) < totNumones(a,b, Z). 

d) Vx < a numonesQ), Z^) < k D totNumones(a,b, Z) < ak. 

Proof. Part a) is proved by induction on b. Part b) is proved by noting that Fo(a + l,b, Z) 
is the concatenation of Fq(cl, b, Z) and Z^ a K 
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For c), the proof is by induction on a. The base case is straightforward. For the 
induction step, note that 

FiniteUnion(a + 1,6, Z) = Union(b, FiniteUnion(a,b, Z), Z^) 

We have 

numones(b, FiniteUnion{a + 1, 6, Z)) 
= numones(b, Union(b, FiniteUnion(a,b, Z), Z^)) 

< numones(b, FiniteUnion(a, 6, Z)) + numones(b, Z^) (by a.) 

< totNumones(a, 6, Z) + numones(b, Z^) (by the I.H.) 
= totNumones{a + 1, 6, Z) (by b.) 

Finally, part d) is proved by induction on a, using part b). □ 

Proof of Theorem W.ll We have to show that there exists a row of X that contains at least 
2 bits. We will prove by contradiction, by showing that if every row of X has at most 1 bit, 
then the total number of bits in the array X is at most a. On the other hand, the union 
of the rows of X has (a + 1) bits. This contradicts part c) of Lemma lB.21 Details are as 
follows. 

Suppose that Vy < a numones(a + l,Xw) < 1. Then part d) of Lemma lB.21 implies 
totNumones(a,a + l,Z) < a. By part c) of Lemma lB.2l numones(a + 1, Finite Union (a, a + 
1)^)) < a - However, it is obvious that Vz < a FiniteUnion(a, a + l,Z)(z). By a sim- 
ple induction argument, this implies numones(a + 1, FiniteUnion(a, a + 1,Z)) = a + 1, a 
contradiction. □ 
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